Neural Bootstrapper
Dec 6, 2021
Speakers
Minsuk Shin
Speaker · 0 followers
Hyungjoo Cho
Speaker · 0 followers
Hyun-seok Min
Speaker · 0 followers
Sungbin Lim
Speaker · 0 followers
About
Bootstrapping has been a primary tool for ensemble and uncertainty quantification in machine learning and statistics. However, due to its nature of multiple training and resampling, bootstrapping deep neural networks is computationally burdensome; hence it has difficulties in practical application to the uncertainty estimation and related tasks. To overcome this computational bottleneck, we propose a novel approach called Neural Bootstrapper (NeuBoots), which learns to generate bootstrapped neural networks through single model training. NeuBoots injects the bootstrap weights into the high-level feature layers of the backbone network and outputs the bootstrapped predictions of the target, without additional parameters and the repetitive computations from scratch. We apply NeuBoots to various machine learning tasks related to uncertainty quantification, including prediction calibrations in image classification and semantic segmentation, active learning, and detection of out-of-distribution samples. Our empirical results show that NeuBoots outperform other bagging based methods in uncertainty quantification, under a much lower computational cost without losing the validity of bootstrapping.Bootstrapping has been a primary tool for ensemble and uncertainty quantification in machine learning and statistics. However, due to its nature of multiple training and resampling, bootstrapping deep neural networks is computationally burdensome; hence it has difficulties in practical application to the uncertainty estimation and related tasks. To overcome this computational bottleneck, we propose a novel approach called Neural Bootstrapper (NeuBoots), which learns to generate bootstrapped neur…
Organizer
NeurIPS 2021
Account · 1.9k followers
About NeurIPS 2021
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Natural Language Processing meets Educational Data Science
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Multi-objective Reinforcement Learning Controller for Multi-Generator Industrial Wave Energy Converter
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Optimal design of interventions in complex socio-economic systems
Watch later
Total of 1 viewers voted for saving the presentation to eternal vault which is 0.1%
Cooperative Multi-Agent Reinforcement Learning for High-Dimensional Nonequilibrium Control
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
How Powerful are Performance Predictors in Neural Architecture Search?
Watch later
Colin White, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Last iterate convergence of SGD for Least-Squares in the Interpolation regime.
Watch later
Aditya Varre, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%