Diversified Recommendations for Agents with Adaptive Preferences
Nov 28, 2022
Speakers
Arpit Agarwal
Speaker · 0 followers
William Brown
Speaker · 0 followers
About
When an Agent visits a platform recommending a menu of content to select from, their choice of item depends not only on immutable preferences, but also on their prior engagements with the platform. The Recommender's primary objective is typically to encourage content consumption which optimizes some reward, such as ad revenue, but they often additionally aim to ensure that a sufficiently wide variety of content is consumed by the Agent over time. We formalize this problem as an adversarial bandit task. At each step, the Recommender presents a menu of k (out of n) items to the Agent, who selects one item in the menu according to their unknown preference model, which maps their history of past items to relative selection probabilities. The Recommender then observes the Agent's selected item and receives bandit feedback of the item's (adversarial) reward. In addition to optimizing reward from the selected items at each step, the Recommender must also ensure that the total distribution of chosen items has sufficiently high entropy. We define a class of preference models which are locally learnable, i.e. behavior over the entire domain can be estimated by only observing behavior in a small region; this includes models representable by bounded-degree polynomials as well as functions with a sparse Fourier basis. For this class, we give an algorithm for the Recommender which obtains O(T^3/4) regret against all item distributions satisfying two conditions: they are sufficiently diversified, and they are instantaneously realizable at any history by some distribution over menus. We show that these conditions are closely connected: all sufficiently high-entropy distributions are instantaneously realizable at any history of selected items. We also give a set of negative results justifying our assumptions, in the form of a runtime lower bound for non-local learning and linear regret lower bounds for alternate benchmarks.When an Agent visits a platform recommending a menu of content to select from, their choice of item depends not only on immutable preferences, but also on their prior engagements with the platform. The Recommender's primary objective is typically to encourage content consumption which optimizes some reward, such as ad revenue, but they often additionally aim to ensure that a sufficiently wide variety of content is consumed by the Agent over time. We formalize this problem as an adversarial bandi…
Organizer
NeurIPS 2022
Account · 953 followers
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
A few fragilities of neural summarizers repetition and synthesis
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Scaling up and Stabilizing Differentiable Planning with Implicit Differentiation
Watch later
Linfeng Zhao, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Active Learning Through a Covering Lens
Watch later
Ofer Yehuda, …
Total of 1 viewers voted for saving the presentation to eternal vault which is 0.1%
Intro and Opening
Watch later
Alex Hanna, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Comparing the carbon costs and benefits of low-resource solar nowcasting
Watch later
Ben Dixon, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
A counterfactual simulation model of causal judgment
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%