An Analysis of Quantile Temporal-Difference Learning

Mark Rowland, Rémi Munos, Mohammad Gheshlaghi Azar, Yunhao Tang, Georg Ostrovski, Anna Harutyunyan, Karl Tuyls, Marc G. Bellemare, Will Dabney

Type: Preprint

Publication Date: 2023-01-01

Citations: 1

DOI: https://doi.org/10.48550/arxiv.2301.04462

View Publication

Locations

arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	A Finite Time Analysis of Temporal Difference Learning With Linear Function Approximation	2018	Jalaj Bhandari Daniel Russo Raghav Singal
+	A Finite Time Analysis of Temporal Difference Learning With Linear Function Approximation.	2018	Jalaj Bhandari Daniel Russo Raghav Singal
+	The Statistical Benefits of Quantile Temporal-Difference Learning for Value Estimation	2023	Mark Rowland Yunhao Tang Clare Lyle Rémi Munos Marc G. Bellemare Will Dabney
+	Control Theoretic Analysis of Temporal Difference Learning	2021	Donghwan Lee
+ PDF Chat	Statistical Efficiency of Distributional Temporal Difference	2024	Peng Yang Liangyu Zhang Zhihua Zhang
+	Target-Based Temporal Difference Learning	2019	Donghwan Lee Niao He
+	Target-Based Temporal Difference Learning	2019	Donghwan Lee Niao He
+	Fixed-Horizon Temporal Difference Methods for Stable Reinforcement Learning	2019	Kristopher De Asis Alan H. S. Chan Silviu Pitis Richard S. Sutton Daniel Graves
+	Proximal Gradient Temporal Difference Learning: Stable Reinforcement Learning with Polynomial Sample Complexity	2020	Bo Liu Ian Gemp Mohammad Ghavamzadeh Ji Liu Sridhar Mahadevan Marek Petrik
+ PDF Chat	Time-Scale Separation in Q-Learning: Extending TD($\triangle$) for Action-Value Function Decomposition	2024	Mahammad Humayoo
+	Fixed-Horizon Temporal Difference Methods for Stable Reinforcement Learning	2019	Kristopher De Asis Alan Chan Silviu Pitis Richard S. Sutton Daniel Graves
+	TD Convergence: An Optimization Perspective	2023	Kavosh Asadi Shoham Sabach Yao Liu Omer Gottesman Rasool Fakoor
+ PDF Chat	Fixed-Horizon Temporal Difference Methods for Stable Reinforcement Learning	2020	Kristopher De Asis Alan Chan Silviu Pitis Richard S. Sutton Daniel Graves
+	Proximal Reinforcement Learning: A New Theory of Sequential Decision Making in Primal-Dual Spaces	2014	Sridhar Mahadevan Bo Liu Philip S. Thomas William Dabney Stephen Giguere Nicholas Jacek Ian Gemp Ji Liu
+ PDF Chat	Demystifying the Recency Heuristic in Temporal-Difference Learning	2024	Brett Daley Marlos C. Machado Martha White
+	Differential Temporal Difference Learning.	2018	Adithya M. Devraj Ioannis Kontoyiannis Sean Meyn
+	Loss Dynamics of Temporal Difference Reinforcement Learning	2023	Blake Bordelon Paul Masset Henry Kuo Cengiz Pehlevan
+	Differential Temporal Difference Learning	2018	Adithya M. Devraj Ioannis Kontoyiannis Sean Meyn
+	Generalized emphatic temporal difference learning: bias-variance analysis	2016	Assaf Hallak Aviv Tamar Rémi Munos Shie Mannor
+ PDF Chat	Proximal Gradient Temporal Difference Learning: Stable Reinforcement Learning with Polynomial Sample Complexity	2018	Bo Liu Ian Gemp Mohammad Ghavamzadeh Ji Liu Sridhar Mahadevan Marek Petrik

Works That Cite This (1)

Action	Title	Year	Authors
+ PDF Chat	Learning Risk-Aware Quadrupedal Locomotion using Distributional Reinforcement Learning	2024	Lukas Schneider Jonas Frey Takahiro Miki Marco Hutter

Works Cited by This (0)

Action	Title	Year	Authors