Deep Learning with Label Differential Privacy
Dec 6, 2021
Speakers
Badih Ghazi
Speaker · 0 followers
Noah Golowich
Speaker · 0 followers
Ravi Kumar
Speaker · 0 followers
Pasin Manurangsi
Speaker · 0 followers
Chiyuan Zhang
Speaker · 0 followers
About
The Randomized Response (RR) algorithm is a classical technique to improve robustness in survey aggregation, and has been widely adopted in applications with differential privacy guarantees. We propose a novel algorithm, Randomized Response with Prior (RRWithPrior), which can provide more accurate results while maintaining the same level of privacy guaranteed by RR. We then apply RRWithPrior to learn neural networks with label differential privacy (LabelDP), and show that when only the label needs to be protected, the model performance can be significantly improved over the previous state-of-the-art private baselines. Moreover, we study different ways to obtain priors, which when used with RRWithPrior can additionally improve the model performance, further reducing the accuracy gap between private and non-private models. We complement the empirical results with theoretical analysis showing that LabelDP is provably easier than protecting both the inputs and labels.The Randomized Response (RR) algorithm is a classical technique to improve robustness in survey aggregation, and has been widely adopted in applications with differential privacy guarantees. We propose a novel algorithm, Randomized Response with Prior (RRWithPrior), which can provide more accurate results while maintaining the same level of privacy guaranteed by RR. We then apply RRWithPrior to learn neural networks with label differential privacy (LabelDP), and show that when only the label nee…
Organizer
NeurIPS 2021
Account · 1.9k followers
About NeurIPS 2021
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Hybrid Physics-Based and Data-Driven Modeling with Calibrated Uncertainty for Li-Ion Battery Degradation Diagnosis and Prognosis
Watch later
Jing Lin, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Enforcing Robustness for Neural Network Policies
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Joint Semantic Mining for Weakly Supervised RGB-D Salient Object Detection
Watch later
Jingjing Li, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Spatio-Temporal Variational Gaussian Processes
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Automated Decision Making under Fairness Constraints
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Autonomous Vehicle Decision-Making Policy Fast Adaptation Using Meta Reinforcement Learning
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%