Controllability-Aware Unsupervised Skill Discovery
Jul 24, 2023
Speakers
Seohong Park
Speaker · 0 followers
Youngwoon Lee
Speaker · 0 followers
Pieter Abbeel
Speaker · 0 followers
About
One of the key capabilities of intelligent agents is the ability to discover useful skills without external supervision. However, the current unsupervised skill discovery methods are often limited to acquiring simple, easy-to-learn skills due to the lack of incentives to discover more complex, challenging behaviors. We introduce a novel unsupervised skill discovery method, **Controllability-aware Skill Discovery** (**CSD**), which actively seeks complex, hard-to-control skills without supervision. The key component of CSD is a controllability-aware distance function, which assigns larger values to state transitions that are harder to achieve with the current skills. Combined with distance-maximizing skill discovery, CSD progressively learns more challenging skills over the course of training as our jointly trained distance function reduces rewards for easy-to-achieve skills. Our experimental results in six robotic manipulation and locomotion environments demonstrate that CSD can discover diverse complex skills including object manipulation and locomotion skills with no supervision, significantly outperforming prior unsupervised skill discovery methods. Videos and code are available at https://sites.google.com/view/icml2023csdOne of the key capabilities of intelligent agents is the ability to discover useful skills without external supervision. However, the current unsupervised skill discovery methods are often limited to acquiring simple, easy-to-learn skills due to the lack of incentives to discover more complex, challenging behaviors. We introduce a novel unsupervised skill discovery method, **Controllability-aware Skill Discovery** (**CSD**), which actively seeks complex, hard-to-control skills without supervisi…
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
SinDDM: A Single Image Denoising Diffusion Model
Watch later
Reality-Centric AI
Watch later
Quantile Credit Assignment
Watch later
Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?
Watch later
Enforcing Right to Explanation: Technical Challenges, Solutions, and Opportunities
Watch later
