InstaHide: Instance-hiding Schemes for Private Distributed Learning
Jul 12, 2020
Speakers
Yangsibo Huang
Speaker · 0 followers
Sanjeev Arora
Speaker · 10 followers
About
An important problem today is how to allow a group of decentralized entities to compute on their private data on a centralized deep net while protecting data privacy. Classic cryptographic techniques are too inefficient, so other methods have recently been suggested, e.g., differentially private Federated Learning. Here, a new method is introduced, inspired by the classic notion of instance hiding in cryptography. It uses the Mixup technique, proposed by Zhang et al, ICLR 2018 as a way to improve generalization and robustness. Usual mixup involves training on nonnegative combinations of inputs. The new ideas in the current paper are: (a) new variants of mixup with negative as well as positive coefficients, and extend the sample-wise mixup to be pixel-wise. (b) Experiments demonstrating the effectiveness of this in protecting privacy against known attacks while preserving utility. (c) Theoretical analysis suggesting why this method is effective, using ideas from analyses of attacks. (d) Estimates of security and the release of a challenge dataset to allow the design of attack schemes.An important problem today is how to allow a group of decentralized entities to compute on their private data on a centralized deep net while protecting data privacy. Classic cryptographic techniques are too inefficient, so other methods have recently been suggested, e.g., differentially private Federated Learning. Here, a new method is introduced, inspired by the classic notion of instance hiding in cryptography. It uses the Mixup technique, proposed by Zhang et al, ICLR 2018 as a way to improv…
Categories
AI & Data Science
Category · 10.8k presentations
About ICML 2020
The International Conference on Machine Learning (ICML) is the premier gathering of professionals dedicated to the advancement of the branch of artificial intelligence known as machine learning. ICML is globally renowned for presenting and publishing cutting-edge research on all aspects of machine learning used in closely related areas like artificial intelligence, statistics and data science, as well as important application areas such as machine vision, computational biology, speech recognition, and robotics. ICML is one of the fastest growing artificial intelligence conferences in the world. Participants at ICML span a wide range of backgrounds, from academic and industrial researchers, to entrepreneurs and engineers, to graduate students and postdocs.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Being Bayesian, Even Just a Bit, Fixes Overconfidence in ReLU Networks
Watch later
Invited Talk 1 Q&A
Watch later
Adding seemingly uninformative labels helps in low data regimes
Watch later
Autoregressive flow-based casual discovery and inference
Watch later
Bounding the fairness and accuracy of classifiers from population statistics
Watch later
Sivan Sabato, …
Preferential Attachment Models: Statistical Analysis and Application
Watch later
Wenpin Tang, …