Indexed Minimal Empirical Divergence for Unimodal Bandits
Dec 6, 2021
Speakers
Hassan Saber
Speaker · 0 followers
Pierre Ménard
Speaker · 0 followers
Odalric-Ambrym Maillard
Speaker · 0 followers
About
We consider a stochastic multi-armed bandit problem specified by a set of one-dimensional family exponential distributions endowed with a unimodal structure. The unimodal structure is of practical relevance for several applications. We introduce IMED-UB, an algorithm that exploits provably optimally the unimodal-structure, by adapting to this setting the Indexed Minimum Empirical Divergence (IMED) algorithm introduced by Honda and Takemura (2015). Owing to our proof technique, we are able to provide a concise finite-time analysis of the IMED-UB algorithm, that is simple and yet yields asymptotic optimality. We finally provide numerical experiments showing that IMED-UB competes favorably with the recently introduced state-of-the-art algorithms.We consider a stochastic multi-armed bandit problem specified by a set of one-dimensional family exponential distributions endowed with a unimodal structure. The unimodal structure is of practical relevance for several applications. We introduce IMED-UB, an algorithm that exploits provably optimally the unimodal-structure, by adapting to this setting the Indexed Minimum Empirical Divergence (IMED) algorithm introduced by Honda and Takemura (2015). Owing to our proof technique, we are able to pro…
Organizer
NeurIPS 2021
Account · 1.9k followers
About NeurIPS 2021
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Random Noise Defense Against Query-Based Black-Box Attacks
Watch later
Zeyu Qin, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Dynamic Trace Estimation
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Towards Building a Responsible Data Economy
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis
Watch later
Xingang Pan, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Data preparation for training CNNs: Application to vibration-based condition monitoring
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Federated Multi-Task Learning under a Mixture of Distributions
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%