Hybrid Stochastic Gradient Descent Algorithms for Stochastic Nonconvex Optimization

Quoc Tran-Dinh, Nhan H. Pham, Dzung T. Phan, Lam M. Nguyen

Type: Preprint

Publication Date: 2019-01-01

Citations: 7

DOI: https://doi.org/10.48550/arxiv.1905.05920

View Publication

Locations

arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	Hybrid Stochastic Gradient Descent Algorithms for Stochastic Nonconvex Optimization	2019	Quoc Tran-Dinh Nhan H. Pham Dzung T. Phan Lam M. Nguyen
+	A Hybrid Stochastic Optimization Framework for Stochastic Composite Nonconvex Optimization	2019	Quoc Tran-Dinh Nhan H. Pham Dzung T. Phan Lam M. Nguyen
+	Hybrid Variance-Reduced SGD Algorithms For Nonconvex-Concave Minimax Problems	2020	Quoc Tran-Dinh Deyi Liu Lam M. Nguyen
+	Momentum-based variance-reduced proximal stochastic gradient method for composite nonconvex stochastic optimization	2020	Yangyang Xu
+	An Optimal Hybrid Variance-Reduced Algorithm for Stochastic Composite Nonconvex Optimization	2020	Deyi Liu Lam M. Nguyen Quoc Tran-Dinh
+	Stochastic Gradient Descent on Nonconvex Functions with General Noise Models	2021	Vivak Patel Shushu Zhang
+	Stochastic Conjugate Frameworks for Nonconvex and Nonsmooth Optimization	2023	Jiangshan Wang Peng Zheng
+	How To Make the Gradients Small Stochastically: Even Faster Convex and Nonconvex SGD	2018	Zeyuan Allen-Zhu
+	How To Make the Gradients Small Stochastically: Even Faster Convex and Nonconvex SGD	2018	Zeyuan Allen-Zhu
+	ProxSARAH: An Efficient Algorithmic Framework for Stochastic Composite Nonconvex Optimization	2019	Nhan H. Pham Lam M. Nguyen Dzung T. Phan Quoc Tran-Dinh
+	Simple and Optimal Stochastic Gradient Methods for Nonsmooth Nonconvex Optimization	2022	Zhize Li Jian Li
+	Momentum Schemes with Stochastic Variance Reduction for Nonconvex Composite Optimization	2019	Yi Zhou Zhe Wang Kaiyi Ji Yingbin Liang Vahid Tarokh
+	Momentum Schemes with Stochastic Variance Reduction for Nonconvex Composite Optimization	2019	Yi Zhou Zhe Wang Kaiyi Ji Yingbin Liang Vahid Tarokh
+ PDF Chat	Shuffling Gradient Descent-Ascent with Variance Reduction for Nonconvex-Strongly Concave Smooth Minimax Problems	2024	Xia Jiang Linglingzhi Zhu Anthony Man–Cho So Shisheng Cui Jian Sun
+ PDF Chat	A single-loop SPIDER-type stochastic subgradient method for expectation-constrained nonconvex nonsmooth optimization	2025	Wei Liu Yangyang Xu
+	A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization	2018	Zhize Li Jian Li
+	Stochastic Gauss-Newton Algorithms for Nonconvex Compositional Optimization	2020	Quoc Tran-Dinh Nhan H. Pham Lam M. Nguyen
+	Stochastic Gauss-Newton Algorithms for Nonconvex Compositional Optimization	2020	Quoc Tran-Dinh Nhan H. Pham Lam M. Nguyen
+	Stochastic Nested Variance Reduction for Nonconvex Optimization	2018	Dongruo Zhou Pan Xu Quanquan Gu
+	Stochastic Variance Reduction for Nonconvex Optimization	2016	Sashank J. Reddi Ahmed Hefny Suvrit Sra Barnabás Póczos Alex Smola

Works That Cite This (6)

Action	Title	Year	Authors
+ PDF Chat	Trust Region Methods for Nonconvex Stochastic Optimization beyond Lipschitz Smoothness	2024	Chenghan Xie Chenxi Li Chuwen Zhang Qi Deng Dongdong Ge Yinyu Ye
+ PDF Chat	A Hybrid Stochastic Gradient Hamiltonian Monte Carlo Method	2021	Chao Zhang Zhijian Li Zebang Shen Jiahao Xie Hui Qian
+ PDF Chat	Passage-Mask: A Learnable Regularization Strategy for Retriever-Reader Models	2022	Shujian Zhang Chengyue Gong Xingchao Liu
+	Riemannian Stochastic Recursive Momentum Method for non-Convex Optimization	2021	Andi Han Junbin Gao
+ PDF Chat	MDPGT: Momentum-Based Decentralized Policy Gradient Tracking	2022	Zhanhong Jiang Xian Yeow Lee Sin Yong Tan Kai Tan Aditya Balu Young Moo Lee Chinmay Hegde Soumik Sarkar
+ PDF Chat	DIAMOND: Taming Sample and Communication Complexities in Decentralized Bilevel Optimization	2023	Peiwen Qiu Yining Li Zhuqing Liu Prashant Khanduri Jia Liu Ness B. Shroff Elizabeth Serena Bentley Kurt Turck

Works Cited by This (0)

Action	Title	Year	Authors