Linear bandits with Stochastic Delayed Feedback
Jul 12, 2020
Speakers
Claire Vernade
Speaker · 0 followers
Alexandra Carpentier
Speaker · 0 followers
Tor Lattimore
Speaker · 1 follower
Giovanni Zappella
Speaker · 0 followers
Beyza Ermis
Speaker · 0 followers
Michael Brueckner
Speaker · 0 followers
About
Stochastic linear bandits are a natural and well-studied model for structured exploration/exploitation problems and are widely used in applications such as on-line marketing and recommendation. One of the main challenges faced by practitioners hoping to apply existing algorithms is that usually the feedback is randomly delayed and delays are only partially observable. For example, while a purchase is usually observable some time after the display, the decision of not buying is never explicitly sent to the system. In other words, the learner only observes delayed positive events. We formalize this problem as a novel stochastic delayed linear bandit and propose OTFLinUCB and OTFLinTS, two computationally efficient algorithms able to integrate new information as it becomes available and to deal with the permanently censored feedback. We prove optimal O(d√(T)) bounds on the regret of the first algorithm and study the dependency on delay-dependent parameters. Our model, assumptions and results are validated by experiments on simulated and real data.Stochastic linear bandits are a natural and well-studied model for structured exploration/exploitation problems and are widely used in applications such as on-line marketing and recommendation. One of the main challenges faced by practitioners hoping to apply existing algorithms is that usually the feedback is randomly delayed and delays are only partially observable. For example, while a purchase is usually observable some time after the display, the decision of not buying is never explicitly s…
Categories
AI & Data Science
Category · 10.8k presentations
About ICML 2020
The International Conference on Machine Learning (ICML) is the premier gathering of professionals dedicated to the advancement of the branch of artificial intelligence known as machine learning. ICML is globally renowned for presenting and publishing cutting-edge research on all aspects of machine learning used in closely related areas like artificial intelligence, statistics and data science, as well as important application areas such as machine vision, computational biology, speech recognition, and robotics. ICML is one of the fastest growing artificial intelligence conferences in the world. Participants at ICML span a wide range of backgrounds, from academic and industrial researchers, to entrepreneurs and engineers, to graduate students and postdocs.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Multi-Agent Determinantal Q-Learning
Watch later
Yaodong Yang, …
Welcome
Watch later
Global Concavity and Optimization in a Class of Dynamic Discrete Choice Models
Watch later
Yiding Feng, …
Smart Sensor Calibration with Auto-Rotating Perceptrons
Watch later
Modeling Continuous Stochastic Processes with Dynamic Normalizing Flows
Watch later
Ruzhi Deng, …