Hindsight Credit Assignment

Anna Harutyunyan, Will Dabney, Thomas Mesnard, Mohammad Gheshlaghi Azar, Bilal Piot, Nicolas Heess, Hado P. van Hasselt, Gregory Wayne, Satinder Singh, Doina Precup

Type: Article

Publication Date: 2019-12-05

Citations: 17

View Publication

Locations

arXiv (Cornell University) - View

Similar Works

Action	Title	Year	Authors
+	Hindsight Credit Assignment	2019	Anna Harutyunyan Will Dabney Thomas Mesnard Mohammad Gheshlaghi Azar Bilal Piot Nicolas Heess Hado van Hasselt Greg Wayne Satinder Singh Doina Precup
+	Hindsight Credit Assignment	2019	Anna Harutyunyan Will Dabney Thomas Mesnard Mohammad Gheshlaghi Azar Bilal Piot Nicolas Heess Hado van Hasselt Greg Wayne Satinder Singh Doina Precup
+	Towards Causal Credit Assignment	2022	Mátyás Schubert
+	A Survey of Temporal Credit Assignment in Deep Reinforcement Learning	2023	Eduardo Pignatelli Johan Ferret Matthieu Geist Thomas Mesnard Hado van Hasselt Laura Toni
+	Variance Reduced Advantage Estimation with $δ$ Hindsight Credit Assignment	2019	Kenny Young
+	Would I have gotten that reward? Long-term credit assignment by counterfactual contribution analysis	2023	Alexander Meulemans Simon Schug Seijin Kobayashi Nathaniel D. Daw Gregory Wayne
+	Towards Practical Credit Assignment for Deep Reinforcement Learning	2021	Vyacheslav Alipov Riley Simmons-Edler Nikita Putintsev Pavel Kalinin Dmitry Vetrov
+	An Information-Theoretic Perspective on Credit Assignment in Reinforcement Learning.	2021	Dilip Arumugam Peter Henderson Pierre‐Luc Bacon
+	Towards Practical Credit Assignment for Deep Reinforcement Learning.	2021	Vyacheslav Alipov Riley Simmons-Edler Nikita Putintsev Pavel Kalinin Dmitry Vetrov
+	Hindsight-DICE: Stable Credit Assignment for Deep Reinforcement Learning	2023	Akash Velu Skanda Vaidyanath Dilip Arumugam
+	An Information-Theoretic Perspective on Credit Assignment in Reinforcement Learning	2021	Dilip Arumugam Peter Henderson Pierre‐Luc Bacon
+	Selective Credit Assignment	2022	Veronica Chelu Diana Borsa Doina Precup Hado van Hasselt
+	Forethought and Hindsight in Credit Assignment	2020	Veronica Chelu Doina Precup Hado van Hasselt
+	Forethought and Hindsight in Credit Assignment	2020	Veronica Chelu Doina Precup Hado van Hasselt
+ PDF Chat	Shapley Counterfactual Credits for Multi-Agent Reinforcement Learning	2021	Jiahui Li Kun Kuang Baoxiang Wang Furui Liu Long Chen Fei Wu Jun Xiao
+	Counterfactual Credit Assignment in Model-Free Reinforcement Learning	2020	Thomas Mesnard Théophane Weber Fabio Viola Shantanu Thakoor Alaa Saade Anna Harutyunyan Will Dabney Tom Stepleton Nicolas Heess Arthur Guez
+	Model-Free Counterfactual Credit Assignment	2021	Thomas Mesnard Théophane Weber Fabio Viola Shantanu Thakoor Alaa Saade Anna Harutyunyan Will Dabney Tom Stepleton Nicolas Heess Marcus Hütter
+	Counterfactual Credit Assignment in Model-Free Reinforcement Learning	2020	Thomas Mesnard Théophane Weber Fabio Viola Shantanu Thakoor Alaa Saade Anna Harutyunyan Will Dabney Tom Stepleton Nicolas Heess Arthur Guez
+	MACCA: Offline Multi-agent Reinforcement Learning with Causal Credit Assignment	2023	Ziyan Wang Yali Du Yudi Zhang Meng Fang Biwei Huang
+	Optimizing Agent Behavior over Long Time Scales by Transporting Value	2018	Chia-Chun Hung Timothy Lillicrap Josh Abramson Yan Wu Mehdi Mirza Federico Carnevale Arun Ahuja Greg Wayne

Works That Cite This (14)

Action	Title	Year	Authors
+	Learning Long-Term Reward Redistribution via Randomized Return Decomposition	2021	Zhizhou Ren Ruihan Guo Yuan Zhou Jian Peng
+	Variance Reduced Advantage Estimation with $δ$ Hindsight Credit Assignment	2019	Kenny Young
+	Preferential Temporal Difference Learning	2021	Nishanth Anand Doina Precup
+	Pairwise Weights for Temporal Credit Assignment.	2021	Zeyu Zheng Risto Vuorio Richard L. Lewis Satinder Singh
+	An Information-Theoretic Perspective on Credit Assignment in Reinforcement Learning.	2021	Dilip Arumugam Peter Henderson Pierre‐Luc Bacon
+	Agent57: Outperforming the Atari Human Benchmark	2020	Adrià Puigdomènech Badia Bilal Piot Steven Kapturowski Pablo Sprechmann Alex Vitvitskyi Daniel Guo Charles Blundell
+	Training Agents using Upside-Down Reinforcement Learning.	2019	Rupesh Kumar Srivastava Pranav Shyam Filipe Mutz Wojciech Jaśkowski Jürgen Schmidhuber
+	Value-driven Hindsight Modelling	2020	Arthur Guez Fabio Viola Théophane Weber Lars Buesing Steven Kapturowski Doina Precup David Silver Nicolas Heess
+	Inductive biases for deep learning of higher-level cognition	2022	Anirudh Goyal Yoshua Bengio
+	Learning Guidance Rewards with Trajectory-space Smoothing	2020	Tanmay Gangwani Yuan Zhou Jian Peng

Works Cited by This (0)

Action	Title	Year	Authors