Le 26 juin dernier, un nouveau projet d’envergure a été lancé : PANAME (Privacy Auditing of AI Models). Développé par la CNIL en partenariat avec le projet IPoP, l’ANSSI, et le PEReN, cet outil open source a pour objectif d’évaluer la confidentialité des modèles d’intelligence artificiellequi manipulent des données personnelles....| IPoP
Rapid advances in Natural Language Processing (NLP) have revolutionized many fields, including healthcare. However, these advances raise significant privacy concerns, especially when models specialized on sensitive data can memorize and then regurgitate Personally Identifiable Information (PII). The objective of this first challenges is to evaluate the utility and privacy trade-off...| IPoP
Bridging AI Developement and Gouvernance - IPoP Workshop 3 April 2024 Overarching topic and goal of the day would be to bring together legal and technical experts on privacy, data protection and AI governance, to discuss the current technical state of the art and how current and upcoming legislation applies...| IPoP
Lancement d'une thèse co-encadrée avec l'AP-HP - Nous sommes ravis d’annoncer la collaboration renforcée avec l’AP-HP avec le co-encadrement (AP-HP / CNIL / IPoP) d’une thèse sur le développement et la mise en oeuvre de méthodes d’évaluation et réduction des risques d’atteintes à la vie privée appliquées à l’usage secondaire des données de santé. Merci au PEPR Cybersécurité...| IPoP
A coordinated response to Chat GPT data protection violations - The Chat GPT Taskforce, set up under the supervision of the Data protection Supervisor, working together with the national data protection authorities, released an intermediary report on Chat GPT [1] on 23 May 2024. The report is essentially focused on data protection violations related to the use and functioning of...| IPoP
The privacy voice challenge 2025 has started! This new edition will focus on the attack part by stressing anonymization schemes and pipelines. The results of this challenge will be presented at the ICASSP25 conference next April.| IPoP
La réunion plénière du projet IPoP a eu lieu dans les locaux de la CNIL le 10 et 11 Septembre dernier. Au programme, présentation des derniers travaux, perspectives pour la prochaine période, présentation des pistes de collaborations avec l’APHP, et session brainstorming avec les services de la CNIL. Réunion prolifique...| IPoP
Three papers from IPoP project will be presented at WISE24, congrats to the authors! Nob-MIAs: Non-biased Membership Inference Attacks Assessment on Large Language Models with Ex-Post Dataset Construction, Cédric Eichler, Nathan Champeil, Nicolas Anciaux, Alexandra Bensamoun, Héber H. Arcolezi, José Maria De Fuentes Abstract: The rise of Large Language Models...| IPoP
Three papers from IPoP project will be presented at ICML24, congrats to the authors! Privacy Attacks in Decentralized Learning, Abdellah El Mrini, Edwige Cyffers, Aurelien Bellet ´ Abstract: Decentralized Gradient Descent (D-GD) allows a set of users to perform collaborative learning without sharing their data by iteratively averaging local model...| IPoP
” One paper from IPoP project will be presented at PETS24, congrats to the authors! The Devil is in the Details: Detection, Measurement and Lawfulness of Server-Side Tracking on the Web, Imane Fouad (Inria Lille, Univ Lille,), Cristiana Santos (Utrecht University), and Pierre Laperdrix (CNRS, Univ Lille, Inria Lille) Abstract:...| IPoP
Récemment adopté, le règlement européen relatif à l’intelligence artificielle (AI Act) ne cesse de faire réagir, qu’il s’agisse de louer ses qualités, et notamment son approche transversale, ou ses défauts, à l’image des besoins de clarté quant aux notions phares retenues. Il n’en demeure pas moins que le texte constitue...| IPoP
DecLearn is a Python package dedicated to federated learning, developed by IPoP (Magnet team) and available as open-source under the Apache 2.0 license. Declearn aims to be a modular and extensible solution for implementing federated learning algorithms, in a real or simulated environment. Enriched over the course of versions, DecLearn...| IPoP
The VoicePrivacy challenge is open! this initiative is spearheading the effort to develop privacy preservations solutions for speech technology. VoicePrivacy takes the form of a competitive benchmarking challenge, with common datasets, protocols and metrics. More information here.| IPoP
Article on AI Act - An article from TheConversation website talks about the regulation of AI.| IPoP
inCyber is the media hub of the cyber community, published by the team behind the FIC (International Cybersecurity Forum). inCyber is a reference publication covering numerous subjects connected to cybersecurity and digital trust. Every day across its website, social media channels and newsletters, inCyber deciphers the latest cyber news, unpacking...| IPoP
what issues? what prospects? - We are organizing a workshop on AI Audit - what issues? what prospects? in Paris (Campys Cyber) on May 13, 2024. The program and more information are available here.| IPoP
Article on Generative AI - An article from TheConversation website talks about the work done in the IPoP project.| IPoP
The IPoP project is strongly mobilized for this PEPR cybersecurity winter school with two keynotes and a large number of student presentations and participants. The program is here.| IPoP
The CNIL published its first practical sheets on AI. These sheets are used to support players in the AI ecosystem in their efforts to comply with legislation on the protection of personal data. The first sheets on the creation of learning datasets for artificial intelligence systems were submitted for public...| IPoP