Tight Finite Time Bounds of Two-Time-Scale Linear Stochastic Approximation with Markovian Noise

Shaan ul Haque, Sajad Khodadadian, Siva Theja Maguluri

Type: Preprint

Publication Date: 2024-01-01

Citations: 0

DOI: https://doi.org/10.48550/arxiv.2401.00364

View Publication

Locations

arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	Finite Time Analysis of Linear Two-timescale Stochastic Approximation with Markovian Noise	2020	Maxim Kaledin Éric Moulines Alexey Naumov Vladislav B. Tadić Hoi-To Wai
+	Finite-Time Analysis and Restarting Scheme for Linear Two-Time-Scale Stochastic Approximation	2019	Thinh T. Doan
+	Finite-Time Analysis and Restarting Scheme for Linear Two-Time-Scale Stochastic Approximation	2019	Thinh T. Doan
+ PDF Chat	Finite-Time Analysis and Restarting Scheme for Linear Two-Time-Scale Stochastic Approximation	2021	Thinh T. Doan
+	Finite Sample Analysis of Two-Timescale Stochastic Approximation with Applications to Reinforcement Learning	2017	Gal Dalal Balázs Szörényi Gugan Thoppe Shie Mannor
+	Two-Timescale Stochastic Approximation Convergence Rates with Applications to Reinforcement Learning	2017	Gal Dalal Balázs Szörényi Gugan Thoppe Shie Mannor
+	Concentration Bounds for Two Timescale Stochastic Approximation with Applications to Reinforcement Learning	2017	Gal Dalal Balázs Szörényi Gugan Thoppe Shie Mannor
+ PDF Chat	Accelerated Multi-Time-Scale Stochastic Approximation: Optimal Complexity and Applications in Reinforcement Learning and Multi-Agent Games	2024	Sihan Zeng Thinh T. Doan
+ PDF Chat	Fast Two-Time-Scale Stochastic Gradient Method with Applications in Reinforcement Learning	2024	Sihan Zeng Thinh T. Doan
+	Linear Stochastic Approximation: Constant Step-Size and Iterate Averaging.	2017	Chandrashekar Lakshminarayanan Csaba Szepesvári
+	Linear Stochastic Approximation: Constant Step-Size and Iterate Averaging	2017	Chandrashekar Lakshminarayanan Csaba Szepesvári
+	A Tale of Two-Timescale Reinforcement Learning with the Tightest Finite-Time Bound	2019	Gal Dalal Balázs Szörényi Gugan Thoppe
+ PDF Chat	A Tale of Two-Timescale Reinforcement Learning with the Tightest Finite-Time Bound	2020	Gal Dalal Balázs Szörényi Gugan Thoppe
+	A Two-Time-Scale Stochastic Optimization Framework with Applications in Control and Reinforcement Learning	2021	Sihan Zeng Thinh T. Doan Justin Romberg
+	Fast Nonlinear Two-Time-Scale Stochastic Approximation: Achieving $O(1/k)$ Finite-Sample Complexity	2024	Thinh T. Doan
+	Sample Complexity Bounds for Two Timescale Value-based Reinforcement Learning Algorithms	2020	Tengyu Xu Yingbin Liang
+	Sample Complexity Bounds for Two Timescale Value-based Reinforcement Learning Algorithms	2020	Tengyu Xu Yingbin Liang
+	Finite-sample Analysis of Greedy-GQ with Linear Function Approximation under Markovian Noise	2020	Yue Wang Shaofeng Zou
+ PDF Chat	A Two-Time-Scale Stochastic Optimization Framework with Applications in Control and Reinforcement Learning	2024	Sihan Zeng Thinh T. Doan Justin Romberg
+	Finite-Sample Analysis for Two Time-scale Non-linear TDC with General Smooth Function Approximation.	2021	Yue Wang Shaofeng Zou Yi Zhou

Works That Cite This (0)

Action	Title	Year	Authors

Works Cited by This (0)

Action	Title	Year	Authors