Towards Effective Context for Meta-Reinforcement Learning: an Approach based on Contrastive Learning

Haotian Fu, Hongyao Tang, Jianye Hao, Chen Chen, Xidong Feng, Li Dong, Wulong Liu

Type: Preprint

Publication Date: 2020-01-01

Citations: 5

DOI: https://doi.org/10.48550/arxiv.2009.13891

View Publication

Locations

arXiv (Cornell University) - View
DataCite API - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	Towards Effective Context for Meta-Reinforcement Learning: an Approach based on Contrastive Learning	2021	Haotian Fu Hongyao Tang Jianye Hao Chen Chen Xidong Feng Li Dong Wulong Liu
+	Improving Context-Based Meta-Reinforcement Learning with Self-Supervised Trajectory Contrastive Learning	2021	Bernie Wang Simon Xu Kurt Keutzer Yang Gao Bichen Wu
+	Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variables	2019	Kate Rakelly Aurick Zhou Deirdre Quillen Chelsea Finn Sergey Levine
+	Improved Context-Based Offline Meta-RL with Attention and Contrastive Learning.	2021	Lanqing Li Yuanhao Huang Dijun Luo
+	Learning Action Translator for Meta Reinforcement Learning on Sparse-Reward Tasks	2022	Yijie Guo Qiucheng Wu Honglak Lee
+ PDF Chat	Learning Action Translator for Meta Reinforcement Learning on Sparse-Reward Tasks	2022	Yijie Guo Qiucheng Wu Honglak Lee
+	Meta Reinforcement Learning with Successor Feature Based Context	2022	Xu Han Feng Wu
+	Meta-Q-Learning	2019	Rasool Fakoor Pratik Chaudhari Stefano Soatto Alexander J. Smola
+	Meta-Q-Learning	2019	Rasool Fakoor Pratik Chaudhari Stefano Soatto Alexander J. Smola
+	Provably Improved Context-Based Offline Meta-RL with Attention and Contrastive Learning	2021	Lanqing Li Yuanhao Huang Mingzhe Chen Siteng Luo Dijun Luo Junzhou Huang
+	Enhanced Meta Reinforcement Learning using Demonstrations in Sparse Reward Environments	2022	Desik Rengarajan Sapana Chaudhary Jae-Won Kim Dileep Kalathil Srinivas Shakkottai
+	Meta-Q-Learning	2020	Rasool Fakoor Pratik Chaudhari Stefano Soatto Alexander J. Smola
+ PDF Chat	Towards an Information Theoretic Framework of Context-Based Offline Meta-Reinforcement Learning	2024	Lanqing Li Hai Zhang Xinyu Zhang Shatong Zhu Junqiao Zhao Pheng‐Ann Heng
+	On Context Distribution Shift in Task Representation Learning for Offline Meta RL	2023	Chenyang Zhao Zihao Zhou Bin Liu
+	MetaCURE: Meta Reinforcement Learning with Empowerment-Driven Exploration	2020	Jin Zhang Jianhao Wang Hao Hu Tong Chen Yingfeng Chen Changjie Fan Chongjie Zhang
+	Meta Reinforcement Learning with Task Embedding and Shared Policy	2019	Lin Lan Zhenguo Li Xiaohong Guan Pinghui Wang
+	Meta Reinforcement Learning with Task Embedding and Shared Policy	2019	Lin Lan Zhenguo Li Xiaohong Guan Pinghui Wang
+ PDF Chat	Scrutinize What We Ignore: Reining Task Representation Shift In Context-Based Offline Meta Reinforcement Learning	2024	Hai Zhang Boyuan Zheng Anqi Guo Tianying Ji Pheng‐Ann Heng Junqiao Zhao Lanqing Li
+ PDF Chat	Retrieval-Augmented Decision Transformer: External Memory for In-context RL	2024	Thomas Schmied Fabian Paischer Vihang Patil Markus Hofmarcher Razvan Pascanu Sepp Hochreiter
+	Learning Context-aware Task Reasoning for Efficient Meta-reinforcement Learning	2020	Haozhe Wang Jiale Zhou Xuming He

Works That Cite This (5)

Action	Title	Year	Authors
+	Improving Context-Based Meta-Reinforcement Learning with Self-Supervised Trajectory Contrastive Learning	2021	Bernie Wang Simon Xu Kurt Keutzer Yang Gao Bichen Wu
+	Represent Your Own Policies: Reinforcement Learning with Policy-extended Value Function Approximator	2020	Hongyao Tang Zhaopeng Meng Jianye Hao Chen Chen Daniel Graves Dong Li Hangyu Mao Wulong Liu Yaodong Yang Changmin Yu
+ PDF Chat	Foresee then Evaluate: Decomposing Value Estimation with Latent Future Prediction	2021	Hongyao Tang Zhaopeng Meng Guangyong Chen Pengfei Chen Chen Chen Yaodong Yang Luo Zhang Wulong Liu Jianye Hao
+	Provably Improved Context-Based Offline Meta-RL with Attention and Contrastive Learning	2021	Lanqing Li Yuanhao Huang Mingzhe Chen Siteng Luo Dijun Luo Junzhou Huang
+	Contrastive Reinforcement Learning of Symbolic Reasoning Domains	2021	Gabriel Poesia WenXin Dong Noah D. Goodman

Works Cited by This (20)

Action	Title	Year	Authors
+	Learning to reinforcement learn	2016	Jane X. Wang Zeb Kurth‐Nelson Dhruva Tirumala Hubert Soyer Joel Z. Leibo Rémi Munos Charles Blundell Dharshan Kumaran Matt Botvinick
+	Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks	2017	Chelsea Finn Pieter Abbeel Sergey Levine
+	Curiosity-driven Exploration by Self-supervised Prediction	2017	Deepak Pathak Pulkit Agrawal Alexei A. Efros Trevor Darrell
+	Representation Learning with Contrastive Predictive Coding	2018	Aäron van den Oord Yazhe Li Oriol Vinyals
+ PDF Chat	Learning Actionable Representations from Visual Observations	2018	Debidatta Dwibedi Jonathan Tompson Corey Lynch Pierre Sermanet
+	Environment Probing Interaction Policies	2019	Wenxuan Zhou Lerrel Pinto Abhinav Gupta
+	Data-Efficient Image Recognition with Contrastive Predictive Coding	2019	Olivier J. Hénaff Aravind Srinivas Jeffrey De Fauw Ali Razavi Carl Doersch S. M. Ali Eslami Aäron van den Oord
+	Trust Region Policy Optimization	2015	John Schulman Sergey Levine Philipp Moritz Michael I. Jordan Pieter Abbeel
+	ProMP: Proximal Meta-Policy Search	2018	Jonas Rothfuss Dennis Lee Ignasi Clavera Tamim Asfour Pieter Abbeel
+	Continuous control with deep reinforcement learning	2016	Timothy Lillicrap Jonathan J. Hunt Alexander Pritzel Nicolas Heess Tom Erez Yuval Tassa David Silver Daan Wierstra