Adaptive Restart for Accelerated Gradient Schemes

Brendan O’Donoghue, Emmanuel J. Candès

Type: Article

Publication Date: 2013-07-02

Citations: 651

DOI: https://doi.org/10.1007/s10208-013-9150-3

View Publication

Download PDF

Locations

Foundations of Computational Mathematics - View
arXiv (Cornell University) - View - PDF

Similar Works

Action	Title	Year	Authors
+	Adaptive Restart for Accelerated Gradient Schemes	2012	Brendan O’Donoghue Emmanuel J. Candès
+	Adaptive Restart for Accelerated Gradient Schemes	2012	Brendan O’Donoghue Emmanuel J. Candès
+	Gradient Methods with Adaptive Step-Sizes	2006	Bin Zhou Li Gao Yu‐Hong Dai
+	Adaptive Step-Size for Non-monotone Gradient Type Methods	2023	I. V. Konnov
+ PDF Chat	Acceleration Methods	2021	Alexandre d’Aspremont Damien Scieur Adrien Taylor
+	Restart Strategies Enabling Automatic Differentiation for Hyperparameter Tuning in Inverse Problems	2024	Leo Davy Nelly Pustelnik Patrice Abry
+	Adaptive Averaging in Accelerated Descent Dynamics	2016	Walid Krichene Alexandre M. Bayen Peter L. Bartlett
+	Adaptive Algorithms for Optimization Beyond Lipschitz Requirements	2022	Kimon Antonakopoulos
+ PDF Chat	Generalized Continuous-Time Models for Nesterov's Accelerated Gradient Methods	2024	Chanwoong Park Youngchae Cho Insoon Yang
+	Advanced gradient schemes	2016	Jeremy Watt Reza Borhani Aggelos K. Katsaggelos
+	Rates of convergence for adaptive Newton methods	1986	SachsE.
+	Rates of convergence for adaptive Newton methods	1986	E. W. Sachs
+ PDF Chat	On accelerated adaptive methods and their modifications for alternating minimization	2022	Nazariy Konstantinovich Tupitsa
+	Incrementally Updated Gradient Methods for Constrained and Regularized Optimization	2013	Paul Tseng Sangwoon Yun
+	Practical Implementations of the Adaptive Regularized Newton Method	2012	Masataka Nishimori
+	A simpler approach to accelerated optimization: iterative averaging meets optimism	2020	Pooria Joulani Anant Raj András György Csaba Szepesvári
+	Online Regularized Nonlinear Acceleration	2018	Damien Scieur Edouard Oyallon Alexandre d’Aspremont Francis Bach
+	Online Regularized Nonlinear Acceleration	2018	Damien Scieur Edouard Oyallon Alexandre d’Aspremont Francis Bach
+	Relaxation Acceleration in Iterative Methods	2000	Sergey Eugenievich Miheev
+	Convergence acceleration methods: The past decade	1985	Claude Brezinski

Works That Cite This (441)

Action	Title	Year	Authors
+ PDF Chat	Sparse regression with Multi-type Regularized Feature modeling	2020	Sander Devriendt Katrien Antonio Tom Reynkens Roel Verbelen
+ PDF Chat	Accelerated Bregman proximal gradient methods for relatively smooth convex optimization	2021	Filip Hanzely Peter Richtárik Lin Xiao
+ PDF Chat	Fast proximal algorithms for nonsmooth convex optimization	2020	Adam Ouorou
+ PDF Chat	Iteratively reweighted $$\ell _1$$ ℓ 1 algorithms with extrapolation	2019	Peiran Yu Ting Kei Pong
+ PDF Chat	Continuous-Time Accelerated Methods via a Hybrid Control Lens	2019	Arman Sharifi Kolarijani Peyman Mohajerin Esfahani Tamás Keviczky
+ PDF Chat	Majorization-minimization-based Levenberg–Marquardt method for constrained nonlinear least squares	2023	Naoki Marumo Takayuki Okuno Akiko Takeda
+ PDF Chat	An Accelerated Proximal Algorithm for the Difference of Convex Programming	2021	Feichao Shen Ying Zhang Xueyong Wang
+	Majorization-Minimization-Based Levenberg--Marquardt Method for Constrained Nonlinear Least Squares	2020	Naoki Marumo Takayuki Okuno Akiko Takeda
+ PDF Chat	Convergence Rate Analysis of the Proximal Difference of the Convex Algorithm	2021	Xueyong Wang Ying Zhang Haibin Chen Xipeng Kou
+	Alternating direction based method for optimal control problem constrained by Stokes equation	2020	Yu Gao Jingzhi Li Yongcun Song Chao Wang Chao Wang Kai Zhang

Works Cited by This (17)

Action	Title	Year	Authors
+	Interior Gradient and Proximal Methods for Convex and Conic Optimization	2006	A. Auslender Marc Teboulle
+	Primal-dual first-order methods with $${\mathcal {O}(1/\epsilon)}$$ iteration-complexity for cone programming	2009	Guanghui Lan Zhaosong Lu Renato D. C. Monteiro
+	A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems	2009	Amir Beck Marc Teboulle
+	An efficient algorithm for a class of fused lasso problems	2010	Jun Liu Lei Yuan Jieping Ye
+ PDF Chat	An iterative thresholding algorithm for linear inverse problems with a sparsity constraint	2004	Ingrid Daubechies Michel Defrise Christine De Mol
+ PDF Chat	Templates for convex cone problems with applications to sparse signal recovery	2011	Stephen R. Becker Emmanuel J. Candès Michael C. Grant
+	Regression Shrinkage and Selection Via the Lasso	1996	Robert Tibshirani
+	Iteration-complexity of first-order penalty methods for convex programming	2012	Guanghui Lan Renato D. C. Monteiro
+	Gradient methods for minimizing composite objective function	2007	Yu. Nesterov
+ PDF Chat	Nonlinear wavelet image processing: variational problems, compression, and noise removal through wavelet shrinkage	1998	Antonin Chambolle Ronald A. De Vore Nam Yong Lee Bradley J. Lucier