Pure Exploration in Kernel and Neural Bandits
Dec 6, 2021
Speakers
Yinglun Zhu
Speaker · 0 followers
Dongruo Zhou
Speaker · 1 follower
Ruoxi Jiang
Speaker · 0 followers
Quanquan Gu
Speaker · 5 followers
Rebecca Willett
Speaker · 0 followers
Robert Nowak
Speaker · 0 followers
About
We study pure exploration in bandits, where the dimension of the feature representation can be much larger than the number of arms. To overcome the curse of dimensionality, we propose to adaptively embed the feature representation of each arm into a lower-dimensional space and carefully deal with the induced model misspecifications. Our approach is conceptually very different from existing works that can either only handle low-dimensional linear bandits or passively deal with model misspecifications. We showcase the application of our approach to two pure exploration settings that were previously under-studied: (1) the reward function belongs to a possibly infinite-dimensional Reproducing Kernel Hilbert Space, and (2) the reward function is nonlinear and can be approximated by neural networks. Our main results provide sample complexity guarantees that only depend on the effective dimension of the feature spaces in the kernel or neural representations. Extensive experiments conducted on both synthetic and real-world datasets demonstrate the efficacy of our methods.We study pure exploration in bandits, where the dimension of the feature representation can be much larger than the number of arms. To overcome the curse of dimensionality, we propose to adaptively embed the feature representation of each arm into a lower-dimensional space and carefully deal with the induced model misspecifications. Our approach is conceptually very different from existing works that can either only handle low-dimensional linear bandits or passively deal with model misspecificat…
Organizer
NeurIPS 2021
Account · 1.9k followers
About NeurIPS 2021
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Modeling Category-Selective Cortical Regions with Topographic Variational Autoencoders
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
KALE Flow: A Relaxed KL Gradient Flow for Probabilities with Disjoint Support
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Tensor decomposition of higher-order correlations by nonlinear Hebbian plasticity
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Machine learning from ground truth: New medical imaging datasets for unsolved medical problems.
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
LiSTra Automatic Speech Translation: English to Lingala case study
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Closing the Loop in Machine Learning: Learning to Optimize with Decision-Dependent Data
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%