PADDLE: Logic Program Guided Policy Reuse in Deep Reinforcement Learning
Dec 15, 2023
Speakers
Tianpei Yang
Speaker · 0 followers
Jianye Hao
Speaker · 0 followers
Matthew E. Taylor
Speaker · 0 followers
About
Learning new skills through previous experience is common in human life, which is the core idea of Transfer Reinforcement Learning (TRL). This requires the agent to learn \emph{when} and \emph{which} source policy is the best to reuse as the target task's policy, and \emph{how} to reuse the source policy. Most TRL methods learn, transfer, and reuse black-box policies, which is hard to explain 1) when to reuse, 2) which source policy is effective, and 3) reduces transfer efficiency. In this paper, we propose a novel TRL method called \textbf{P}rogr\textbf{A}m gui\textbf{D}e\textbf{D} po\textbf{L}icy r\textbf{E}use (PADDLE) that can measure the logic similarities between tasks and transfer knowledge with interpretable cause-effect logic to the target task. To achieve this, we first propose a hybrid decision model that synthesizes high-level logic programs and learns low-level DRL policy to learn multiple source tasks. Second, we estimate the logic similarity between the target task and the source tasks and combine it with the low-level policy similarity to select the appropriate source policy as the guiding policy for the target task. Experimental results show that our method can effectively select the appropriate source tasks to guide learning on the target task, outperforming black-box TRL methods.Learning new skills through previous experience is common in human life, which is the core idea of Transfer Reinforcement Learning (TRL). This requires the agent to learn \emph{when} and \emph{which} source policy is the best to reuse as the target task's policy, and \emph{how} to reuse the source policy. Most TRL methods learn, transfer, and reuse black-box policies, which is hard to explain 1) when to reuse, 2) which source policy is effective, and 3) reduces transfer efficiency. In this paper…
Organizer
NeurIPS 2023
Account · 615 followers
Like the format? Trust SlidesLive to capture your next event!
Professional recording and live streaming, delivered globally.
Sharing
Recommended Videos
Presentations on similar topic, category or speaker
On Mitigating Unconscious Bias through Bandits with Evolving Biased Feedback
Watch later
Matthew Faw, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
PaSS: Parallel Speculative Sampling
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
DatasetDM: Synthesizing Data with Perception Annotations Using Diffusion Models
Watch later
Weijia Wu, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Bridging the Dataset Gap in Automated Citation Screening for Systematic Literature Reviews
Watch later
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
Adversarial Robustness in Graph Neural Networks: A Hamiltonian Approach
Watch later
Kai Zhao, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%
TempME: Towards the Explainability of Temporal Graph Neural Networks via Motif Discovery
Watch later
Jialin Chen, …
Total of 0 viewers voted for saving the presentation to eternal vault which is 0.0%