Agent Modelling under Partial Observability for Deep Reinforcement Learning
Dec 6, 2021
Speakers
Georgios Papoudakis
Speaker · 0 followers
Filippos Christianos
Speaker · 0 followers
Stefano V. Albrecht
Speaker · 0 followers
About
Modelling the behaviours of other agents is essential for understanding how agents interact and making effective decisions. Existing methods for agent modelling commonly assume knowledge of the local observations and chosen actions of the modelled agents during execution. To eliminate this assumption, we extract representations from the local information of the controlled agent using encoder-decoder architectures. Using the observations and actions of the modelled agents during training, our models learn to extract representations about the modelled agents conditioned only on the local observations of the controlled agent. The representations are used to augment the controlled agent's decision policy which is trained via deep reinforcement learning; thus, during execution, the policy does not require access to other agents' information. We provide a comprehensive evaluation and ablations studies in cooperative, competitive and mixed multi-agent environments, showing that our method achieves significantly higher returns than baseline methods which do not use the learned representations.Modelling the behaviours of other agents is essential for understanding how agents interact and making effective decisions. Existing methods for agent modelling commonly assume knowledge of the local observations and chosen actions of the modelled agents during execution. To eliminate this assumption, we extract representations from the local information of the controlled agent using encoder-decoder architectures. Using the observations and actions of the modelled agents during training, our mod…
Organizer
NeurIPS 2021
Account · 1.9k followers
About NeurIPS 2021
Neural Information Processing Systems (NeurIPS) is a multi-track machine learning and computational neuroscience conference that includes invited talks, demonstrations, symposia and oral and poster presentations of refereed papers. Following the conference, there are workshops which provide a less formal setting.
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
Asynchronous Stochastic Optimization Robust to Arbitrary Delays
Watch later
Alon Cohen, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Sparse Steerable Convolutions: An Efficient Learning of SE(3)-Equivariant Features for Estimation and Tracking of Object Poses in 3D Space
Watch later
Jiehong Lin, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Anti-Backdoor Learning: Training Clean Models on Poisoned Data
Watch later
Yige Li, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Scalable Bayesian GPFA with automatic relevance determination and discrete noise models
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Leveraging the Inductive Bias of Large Language Models for Abstract Textual Reasoning
Watch later
Christopher Michael Rytting, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Sequential Algorithms for Testing Closeness of Distributions
Watch later
Omar Fawzi, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%