Red teaming privacy-preserving systems using AI

Companies and governments are increasingly relying on privacy-preserving techniques to collect and process sensitive data. In this talk, I will discuss our efforts to red team deployed systems and argue that red teaming is essential to protect privacy in practice. I will first shortly describing how traditional de-identification techniques mostly fail in the age of big data. I will then show how implementation choices and trade-offs have enabled attacks against real-world systems, from query-based systems to differential privacy mechanisms and synthetic data. I will then conclude by describing recent successes in using AI to automatically discover vulnerabilities.

https://cam-ac-uk.zoom.us/j/84870530081?pwd=aGRsYkpyS0Vpc2c4SDBRVDJvUkxZQT09