Reinforcement Learning with Unsupervised Auxiliary Tasks

Max Jaderberg, Volodymyr Mnih, Wojciech Marian Czarnecki, Tom Schaul, Joel Z. Leibo, David Silver, Koray Kavukcuoglu

Type: Preprint

Publication Date: 2016-01-01

Citations: 757

DOI: https://doi.org/10.48550/arxiv.1611.05397

View Publication

Locations

arXiv (Cornell University) - View
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	Reinforcement Learning with Unsupervised Auxiliary Tasks	2016	Max Jaderberg Volodymyr Mnih Wojciech Marian Czarnecki Tom Schaul Joel Z. Leibo David Silver Koray Kavukcuoglu
+	URLB: Unsupervised Reinforcement Learning Benchmark	2021	Michael Laskin Denis Yarats Hao Liu Kimin Lee Albert Zhan Kevin Lü Catherine Cang Lerrel Pinto Pieter Abbeel
+	URLB: Unsupervised Reinforcement Learning Benchmark.	2021	Michael Laskin Denis Yarats Hao Liu Kimin Lee Albert Zhan Kevin Lü Catherine Cang Lerrel Pinto Pieter Abbeel
+	Behavior From the Void: Unsupervised Active Pre-Training	2021	Hao Liu Pieter Abbeel
+	Open-Ended Reinforcement Learning with Neural Reward Functions	2022	R. R. Meier Asier Mujika
+	Behavior From the Void: Unsupervised Active Pre-Training.	2021	Hao Liu Pieter Abbeel
+	Unsupervised Perceptual Rewards for Imitation Learning	2017	Pierre Sermanet Kelvin Xu Sergey Levine
+ PDF Chat	Pre-training with non-expert human demonstration for deep reinforcement learning	2019	Gabriel Cruz Yunshu Du Matthew E. Taylor
+	Loss is its own Reward: Self-Supervision for Reinforcement Learning	2016	Evan Shelhamer Parsa Mahmoudieh Max Argus Trevor Darrell
+	Loss is its own Reward: Self-Supervision for Reinforcement Learning	2016	Evan Shelhamer Parsa Mahmoudieh Max Argus Trevor Darrell
+ PDF Chat	Image-Based Deep Reinforcement Learning with Intrinsically Motivated Stimuli: On the Execution of Complex Robotic Tasks	2024	David Valencia Henry Williams Yuning Xing Trevor Gee Minas Liarokapis Bruce A. MacDonald
+	SQIL: Imitation Learning via Reinforcement Learning with Sparse Rewards	2019	Siddharth Reddy Anca D. Dragan Sergey Levine
+	SQIL: Imitation Learning via Reinforcement Learning with Sparse Rewards	2019	Siddharth Reddy Anca D. Dragan Sergey Levine
+	Generalizing Skills with Semi-Supervised Reinforcement Learning	2016	Chelsea Finn Tianhe Yu Justin Fu Pieter Abbeel Sergey Levine
+	Leveraging Human Guidance for Deep Reinforcement Learning Tasks	2019	Ruohan Zhang Faraz Torabi Lin Guan Dana H. Ballard Peter Stone
+	Leveraging Human Guidance for Deep Reinforcement Learning Tasks	2019	Ruohan Zhang Faraz Torabi Lin Guan Dana H. Ballard Peter Stone
+	Does Self-supervised Learning Really Improve Reinforcement Learning from Pixels?	2022	Xiang Li Jinghuan Shang Srijan Das Michael S. Ryoo
+	SEIHAI: A Sample-efficient Hierarchical AI for the MineRL Competition	2021	Hangyu Mao Chao Wang Xiaotian Hao Yihuan Mao Yiming Lu Chengjie Wu Jianye Hao Dong Li Pingzhong Tang
+	Simplifying Deep Reinforcement Learning via Self-Supervision	2021	Daochen Zha Kwei-Herng Lai Kaixiong Zhou Xia Hu
+ PDF Chat	Deep Reinforcement Learning with Hybrid Intrinsic Reward Model	2025	Mingqi Yuan Bo Li Xin Jin Wenjun Zeng

Works That Cite This (517)

Action	Title	Year	Authors
+ PDF Chat	Probabilistic Future Prediction for Video Scene Understanding	2020	Anthony Hu Fergal Cotter Nikhil Mohan Corina Gurău Alex Kendall
+ PDF Chat	Curious Hierarchical Actor-Critic Reinforcement Learning	2020	Frank Röder Manfred Eppe Phuong D. H. Nguyen Stefan Wermter
+	Reward-Respecting Subtasks for Model-Based Reinforcement Learning	2022	Richard S. Sutton Marlos C. Machado Gerhard Holland David Szepesvari Finbarr Timbers B. K. Tanner Adam White
+	Difference Rewards Policy Gradients	2020	Jacopo Castellini Sam Devlin Frans A. Oliehoek Rahul Savani
+ PDF Chat	Deep Reinforcement Learning for Cyber Security	2021	Thanh Thi Nguyen Vijay Janapa Reddi
+ PDF Chat	Selective Experience Replay for Lifelong Learning	2018	David Isele Akansel Cosgun
+ PDF Chat	Deep Reinforcement Learning	2019	Chong Li
+ PDF Chat	A multi-objective deep reinforcement learning framework	2020	Thanh Thi Nguyen Ngoc Duy Nguyen Peter Vamplew Saeid Nahavandi Richard Dazeley Chee Peng Lim
+	Dex: Incremental Learning for Complex Environments in Deep Reinforcement Learning	2017	Nick Erickson Qi Zhao
+ PDF Chat	Mastering Atari, Go, chess and shogi by planning with a learned model	2020	Julian Schrittwieser Ioannis Antonoglou Thomas Hubert Karen Simonyan Laurent Sifre Simon Schmitt Arthur Guez Edward Lockhart Demis Hassabis Thore Graepel

Works Cited by This (12)

Action	Title	Year	Authors
+	Recurrent Reinforcement Learning: A Hybrid Approach	2015	Xiujun Li Lihong Li Jianfeng Gao Xiaodong He Jianshu Chen Li Deng Ji He
+	Action-Conditional Video Prediction using Deep Networks in Atari Games	2015	Junhyuk Oh Xiaoxiao Guo Honglak Lee Richard L. Lewis Satinder Singh
+	Prioritized Experience Replay	2015	Tom Schaul John Quan Ioannis Antonoglou David Silver
+	A Deep Hierarchical Approach to Lifelong Learning in Minecraft	2016	Chen Tessler Shahar Givony Tom Zahavy Daniel J. Mankowitz Shie Mannor
+	ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learning	2016	Michał Kempka Marek Wydmuch Grzegorz Runc Jakub Toczek Wojciech Jaśkowski
+	Deep Successor Reinforcement Learning	2016	Tejas D. Kulkarni Ardavan Saeedi Simanta Gautam Samuel J. Gershman
+	Successor Features for Transfer in Reinforcement Learning	2016	André Sales Barreto Will Dabney Rémi Munos Jonathan J. Hunt Tom Schaul Hado van Hasselt David Silver
+	Graying the black box: Understanding DQNs	2016	Tom Zahavy Nir Ben Zrihem Shie Mannor
+	Compositional Planning Using Optimal Option Models	2012	David Silver Kamil Ciosek
+ PDF Chat	Model-based reinforcement learning with parametrized physical models and optimism-driven exploration	2016	Chris Xie Sachin Patil Teodor Mihai Moldovan Sergey Levine Pieter Abbeel