Stochastic Gradient Descent with Noise of Machine Learning Type Part II: Continuous Time Analysis

Stephan Wojtowytsch

Type: Article

Publication Date: 2023-11-15

Citations: 5

DOI: https://doi.org/10.1007/s00332-023-09992-0

View Publication

Locations

Journal of Nonlinear Science - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	Stochastic Gradient Descent with Noise of Machine Learning Type Part I: Discrete Time Analysis	2023	Stephan Wojtowytsch
+	Stochastic gradient descent with noise of machine learning type. Part II: Continuous time analysis	2021	Stephan Wojtowytsch
+	Stochastic gradient descent with noise of machine learning type. Part I: Discrete time analysis	2021	Stephan Wojtowytsch
+ PDF Chat	Correction to: analysis of stochastic gradient descent in continuous time	2024	Jonas Latz
+	Stochastic gradient descent	2018	Andrew Murphy David Wang
+ PDF Chat	Stochastic Gradient Descent with Polyak’s Learning Rate	2021	Mariana Prazeres Adam M. Oberman
+	Stability and optimality in stochastic gradient descent.	2015	Panos Toulis Dustin Tran Edoardo M. Airoldi
+ PDF Chat	Correction to: The continuous stochastic gradient method: part II–application and numerics	2023	Max Grieshammer Lukas Pflug Michael Stingl Andrian Uihlein
+	A comparison of continuous-time approximations to stochastic gradient descent	2023	Stefan Ankirchner Stefan Perko
+	Stochastic gradient method in infinite-dimensional space	1975	Z. V. Nekrylova
+	Convergence rate of stochastic gradient with constant step size	2014	Mark Schmidt
+ PDF Chat	A stochastic gradient type algorithm for closed-loop problems	2007	Kengy Barty Jean‐Sébastien Roy Cyrille Strugarek
+	Stochastic Gradient Descent in Continuous Time: A Central Limit Theorem	2017	Justin Sirignano Konstantinos Spiliopoulos
+	Stochastic Gradient Descent in Continuous Time: A Central Limit Theorem	2017	Justin Sirignano Konstantinos Spiliopoulos
+	Stochastic Gradient Descent in Continuous Time: A Central Limit Theorem	2017	Justin Sirignano Konstantinos Spiliopoulos
+ PDF Chat	Stochastic Gradient Descent for Linear Systems with Missing Data	2019	Anna Ma and Deanna Needell
+	Stochastic Gradient Descent	2021
+	Stochastic Gradient Descent	2014	Shai Shalev‐Shwartz Shai Ben-David
+	Convergence analysis of gradient descent stochastic algorithms	1996	Alexander Shapiro Y. Wardi
+	Nonlinear stochastic gradient adaptation : analysis and optimization	1992	Scott Clinton Douglas

Works That Cite This (5)

Action	Title	Year	Authors
+	Fast convergence to non-isolated minima: four equivalent conditions for $${\textrm{C}^{2}}$$ functions	2024	Quentin Rebjock Nicolas Boumal
+ PDF Chat	Stochastic Modified Flows for Riemannian Stochastic Gradient Descent	2024	Benjamin Gess Sebastian Kassing Nimit Rana
+ PDF Chat	Stochastic Gradient Descent with Noise of Machine Learning Type Part I: Discrete Time Analysis	2023	Stephan Wojtowytsch
+	SGD May Never Escape Saddle Points	2021	Ziyin Liu Botao Li James B. Simon Masahito Ueda
+	On minimal representations of shallow ReLU networks	2021	Steffen Dereich Sebastian Kassing

Works Cited by This (52)

Action	Title	Year	Authors
+ PDF Chat	Bounds for the Discrete Part of the Spectrum of a Semi-Bounded Schrödinger Operator.	1960	Arne Persson
+	About the Hardy Inequality	2011	Nader Masmoudi
+ PDF Chat	Elliptic Partial Differential Equations of Second Order	2001	David Gilbarg Neil S. Trudinger
+	Fractional diffusion and Lévy stable processes	1997	Bruce J. West Paolo Grigolini Ralf Metzler Theo F. Nonnenmacher
+	A Liouville Theorem for Degenerate Elliptic Equations	1973	D. E. Edmunds L. A. Peletier
+ PDF Chat	Improved Poincaré inequalities	2012	Jean Dolbeault Bruno Volzone
+	The Variational Formulation of the Fokker--Planck Equation	1998	Richard W. Jordan David Kinderlehrer Félix Otto
+ PDF Chat	On the Heat Diffusion for Generic Riemannian and Sub-Riemannian Structures	2016	Davide Barilari Ugo Boscain G. Charlot Robert W. Neel
+	Sharp rates of decay of solutions to the nonlinear fast diffusion equation via functional inequalities	2010	Matteo Bonforte Jean Dolbeault Gabriele Grillo Juan Luís Vázquez
+	Bayesian Learning via Stochastic Gradient Langevin Dynamics	2011	Max Welling Yee Whye Teh