Control Variates for Slate Off-Policy Evaluation
Dec 6, 2021
Speakers
Nikos Vlassis
Speaker · 0 followers
Ashok Chandrashekar
Speaker · 0 followers
Fernando Amat
Speaker · 0 followers
Nathan Kallus
Speaker · 2 followers
About
We study the problem of off-policy evaluation from batched contextual bandit data with multidimensional actions, often termed slates. The problem is common to recommender systems and user-interface optimization, and it is particularly challenging because of the combinatorially-sized action space. Swaminathan et al. (2017) have proposed the pseudoinverse (PI) estimator under the assumption that the conditional mean rewards are additive in actions. Using control variates, we consider a large class of unbiased estimators that includes as specific cases the PI estimator and (asymptotically) its self-normalized variant. By optimizing over this class, we obtain new estimators with risk improvement guarantees over both the PI and self-normalized PI estimators. Experiments with real-world recommender data as well as synthetic data validate these improvements in practice.We study the problem of off-policy evaluation from batched contextual bandit data with multidimensional actions, often termed slates. The problem is common to recommender systems and user-interface optimization, and it is particularly challenging because of the combinatorially-sized action space. Swaminathan et al. (2017) have proposed the pseudoinverse (PI) estimator under the assumption that the conditional mean rewards are additive in actions. Using control variates, we consider a large class…
Organizer
NeurIPS 2021
Account · 1.9k followers
About NeurIPS 2021
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Adversarial Robustness with Non-uniform Perturbations
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Learning Domain Invariant Representations in Goal-conditioned Block MDPs
Watch later
Beining Han, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Grounding Spatio-Temporal Language With Transformers
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Multiple Instance Learning for Brain Tumor Detection with Magnetic Resonance Spectroscopy Data
Watch later
Diyuan Lu, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Traffic4cast 2021 Competition
Watch later
Moritz Neun, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Transfer RL across Observation Feature Spaces via Model-Based Regularization
Watch later
Yanchao Sun, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%