Mini-batch Stochastic Approximation Methods for Nonconvex Stochastic Composite Optimization

Saeed Ghadimi, Guanghui Lan, Hongchao Zhang

Type: Preprint

Publication Date: 2013-01-01

Citations: 11

DOI: https://doi.org/10.48550/arxiv.1308.6594

View Publication

Locations

arXiv (Cornell University) - View
DataCite API - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	Mini-batch stochastic approximation methods for nonconvex stochastic composite optimization	2014	Saeed Ghadimi Guanghui Lan Hongchao Zhang
+	Mini-batch stochastic Nesterov's smoothing method for constrained convex stochastic composite optimization	2021	Ruyu Wang Chao Zhang Lichun Wang Yuan‐Hai Shao
+	A Hybrid Stochastic Optimization Framework for Stochastic Composite Nonconvex Optimization	2019	Quoc Tran-Dinh Nhan H. Pham Dzung T. Phan Lam M. Nguyen
+ PDF Chat	Adaptive smoothing mini-batch stochastic accelerated gradient method for nonsmooth convex stochastic composite optimization	2021	Ruyu Wang Chao Zhang
+	Adaptive smoothing mini-batch stochastic accelerated gradient method for nonsmooth convex stochastic composite optimization	2021	Wang Ruyu Chao Zhang
+	Stochastic smoothing accelerated gradient method for nonsmooth convex composite optimization	2023	Ruyu Wang Chao Zhang
+ PDF Chat	Momentum-Based Variance-Reduced Proximal Stochastic Gradient Method for Composite Nonconvex Stochastic Optimization	2022	Yangyang Xu Yibo Xu
+	Stochastic Gradient Descent for Stochastic Doubly-Nonconvex Composite Optimization	2018	Takayuki Kawashima Hironori Fujisawa
+	An Optimal Hybrid Variance-Reduced Algorithm for Stochastic Composite Nonconvex Optimization	2020	Deyi Liu Lam M. Nguyen Quoc Tran-Dinh
+	A Simple Proximal Stochastic Gradient Method for Nonsmooth Nonconvex Optimization	2018	Zhize Li Jian Li
+ PDF Chat	Proximally Guided Stochastic Subgradient Method for Nonsmooth, Nonconvex Problems	2019	Damek Davis Benjamin Grimmer
+	Stochastic Quasi-Newton Methods for Nonconvex Stochastic Optimization	2014	Xiao Wang Shiqian Ma Wei Liu
+	Stochastic proximal quasi-Newton methods for non-convex composite optimization	2018	Xiaoyu Wang Xiao Wang Ya-xiang Yuan
+	Accelerated Stochastic Algorithms for Nonconvex Finite-sum and Multi-block Optimization	2018	Guanghui Lan Yu Yang
+	Stochastic subgradient for composite convex optimization with functional constraints	2022	Ion Necoara Nitesh Kumar Singh
+ PDF Chat	Inexact-Proximal Accelerated Gradient Method for Stochastic Nonconvex Constrained Optimization Problems	2021	Morteza Boroun Afrooz Jalilzadeh
+	Inexact-Proximal Accelerated Gradient Method for Stochastic Nonconvex Constrained Optimization Problems	2021	Morteza Boroun Afrooz Jalilzadeh
+	Mini-Batch Stochastic ADMMs for Nonconvex Nonsmooth Optimization	2018	Feihu Huang Songcan Chen
+ PDF Chat	Variance Reduction and Low Sample Complexity in Stochastic Optimization via Proximal Point Method	2024	Jiaming Liang
+	ProxSARAH: An Efficient Algorithmic Framework for Stochastic Composite Nonconvex Optimization	2019	Nhan H. Pham Lam M. Nguyen Dzung T. Phan Quoc Tran-Dinh

Works That Cite This (11)

Action	Title	Year	Authors
+	Variance Reduction on Adaptive Stochastic Mirror Descent.	2020	Wenjie Li Zhanyu Wang Yichen Zhang Guang Cheng
+	Decomposing Linearly Constrained Nonconvex Problems by a Proximal Primal Dual Approach: Algorithms, Convergence, and Applications	2016	Mingyi Hong
+	Penalty Methods with Stochastic Approximation for Stochastic Nonlinear Programming	2013	Xiao Wang Shiqian Ma Ya-xiang Yuan
+	Complexity Lower Bounds for Nonconvex-Strongly-Concave Min-Max Optimization	2021	Haochuan Li Yi Tian Jingzhao Zhang Ali Jadbabaie
+	Convergence Analysis of Alternating Direction Method of Multipliers for a Family of Nonconvex Problems	2014	Mingyi Hong Zhi‐Quan Luo Meisam Razaviyayn
+	Hogwild! over Distributed Local Data Sets with Linearly Increasing Mini-Batch Sizes	2020	Marten van Dijk Nhuong V. Nguyen Toan N. Nguyen Lam M. Nguyen Quoc Tran-Dinh Phuong Ha Nguyen
+	Iteration Bounds for Finding the $\epsilon$-Stationary Points for Structured Nonconvex Optimization	2014	Bo Jiang Shuzhong Zhang
+	Stochastic Frank-Wolfe Methods for Nonconvex Optimization	2016	Sashank J. Reddi Suvrit Sra Barnabás Póczos Alex Smola
+	Faster Stochastic Variational Inference using Proximal-Gradient Methods with General Divergence Functions	2015	Mohammad Emtiyaz Khan Reza Babanezhad Lin Wu Mark Schmidt Masashi Sugiyama
+	Block stochastic gradient iteration for convex and nonconvex optimization	2014	Yangyang Xu Wotao Yin

Works Cited by This (12)

Action	Title	Year	Authors
+	Interior Gradient and Proximal Methods for Convex and Conic Optimization	2006	A. Auslender Marc Teboulle
+	Robust Stochastic Approximation Approach to Stochastic Programming	2009	Arkadi Nemirovski Anatoli Juditsky Guanghui Lan Alexander Shapiro
+	Convergence of Proximal-Like Algorithms	1997	Marc Teboulle
+	Validation analysis of mirror descent stochastic approximation method	2011	Guanghui Lan Arkadi Nemirovski Alexander Shapiro
+	The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming	1967	L.M. Bregman
+	On the Complexity of Steepest Descent, Newton's and Regularized Newton's Methods for Nonconvex Unconstrained Optimization Problems	2010	Coralia Cartis Nicholas I. M. Gould Philippe L. Toint
+	Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties	2001	Jianqing Fan Runze Li
+ PDF Chat	Bregman Monotone Optimization Algorithms	2003	Heinz H. Bauschke Jonathan M. Borwein Patrick L. Combettes
+ PDF Chat	On the convergence properties of non-Euclidean extragradient methods for variational inequalities with generalized monotone operators	2014	Cong D. Dang Guanghui Lan
+ PDF Chat	Randomized Smoothing for Stochastic Optimization	2012	John C. Duchi Peter L. Bartlett Martin J. Wainwright