Linear Rate Convergence of the Alternating Direction Method of Multipliers for Convex Composite Programming

Type: Article

Publication Date: 2017-12-15

Citations: 103

DOI: https://doi.org/10.1287/moor.2017.0875

Abstract

In this paper, we aim to prove the linear rate convergence of the alternating direction method of multipliers (ADMM) for solving linearly constrained convex composite optimization problems. Under a mild calmness condition, which holds automatically for convex composite piecewise linear-quadratic programming, we establish the global Q-linear rate of convergence for a general semi-proximal ADMM with the dual step-length being taken in (0, (1+5 1/2 )/2). This semi-proximal ADMM, which covers the classic one, has the advantage to resolve the potentially nonsolvability issue of the subproblems in the classic ADMM and possesses the abilities of handling the multi-block cases efficiently. We demonstrate the usefulness of the obtained results when applied to two- and multi-block convex quadratic (semidefinite) programming.

Locations

  • PolyU Institutional Research Archive (Hong Kong Polytechnic University) - View - PDF
  • Mathematics of Operations Research - View

Similar Works

Action Title Year Authors
+ Linear Rate Convergence of the Alternating Direction Method of Multipliers for Convex Composite Quadratic and Semi-Definite Programming 2015 Deren Han
Defeng Sun
Liwei Zhang
+ Linear Convergence Rate Analysis of Proximal Generalized ADMM for Convex Composite Programming 2022 Han Wang
Yunhai Xiao
+ PDF Chat A Majorized ADMM with Indefinite Proximal Terms for Linearly Constrained Convex Composite Optimization 2016 Min Li
Defeng Sun
Kim-Chuan Toh
+ A Generalized Alternating Direction Method of Multipliers with Semi-Proximal Terms for Convex Composite Conic Programming 2015 Yunhai Xiao
Liang Chen
Donghui Li
+ PDF Chat A Unified Algorithmic Framework of Symmetric Gauss-Seidel Decomposition Based Proximal Admms for Convex Composite Programming 2019 Liang Chen sci
+ A Majorized ADMM with Indefinite Proximal Terms for Linearly Constrained Convex Composite Optimization 2014 Min Li
Defeng Sun
Kim-Chuan Toh
+ On the Equivalence of Inexact Proximal ALM and ADMM for a Class of Convex Composite Programming 2018 Liang Chen
Xudong Li
Defeng Sun
Kim-Chuan Toh
+ Iteration complexity analysis of a partial LQP-based alternating direction method of multipliers 2021 Jianchao Bai
Yuxue Ma
Hao Sun
Miao Zhang
+ On the Linear Convergence Rate of Generalized ADMM for Convex Composite Programming 2022 Han Wang
Peili Li
Yunhai Xiao
+ PDF Chat An Adaptive Proximal ADMM for Nonconvex Linearly-Constrained Composite Programs 2024 Leandro Farias Maia
David H. Gutman
Renato D. C. Monteiro
Gilson N. Silva
+ PDF Chat On the linear convergence rate of generalized ADMM for convex composite programming 2024 Han Wang
Peili Li
Yunhai Xiao
+ PDF Chat A linearly convergent majorized ADMM with indefinite proximal terms for convex composite programming and its applications 2019 Ning Zhang
Jia Wu
Liwei Zhang
+ PDF Chat Convergence analysis of generalized ADMM with majorization for linearly constrained composite convex optimization 2023 Hongwu Li
Haibin Zhang
Yunhai Xiao
Peili Li
+ PDF Chat A Convergent 3-Block Semi-Proximal ADMM for Convex Minimization Problems with One Strongly Convex Block 2015 Min Li
Defeng Sun
Kim-Chuan Toh
+ Convergence Analysis of Generalized ADMM with Majorization for Linearly Constrained Composite Convex Optimization 2022 Hongwu Li
Haibin Zhang
Yunhai Xiao
+ Linear Convergence of the Alternating Direction Method of Multipliers for a Class of Convex Optimization Problems 2016 Yang Wei
Deren Han
+ PDF Chat A proximal alternating direction method for multi-block coupled convex optimization 2019 Foxiang Liu
Lingling Xu
Yuehong Sun
Deren Han
+ A Linearly Convergent Majorized ADMM with Indefinite Proximal Terms for Convex Composite Programming and Its Applications 2017 Ning Zhang
Jia Wu
Liwei Zhang
+ PDF Chat Multi-block Nonconvex Nonsmooth Proximal ADMM: Convergence and Rates Under Kurdyka–Łojasiewicz Property 2021 Maryam Yashtini
+ On the Q-linear Convergence of a Majorized Proximal ADMM for Convex Composite Programming and Its Applications to Regularized Logistic Regression 2017 Ning Zhang
Jia Wu
Liwei Zhang

Works That Cite This (73)

Action Title Year Authors
+ Sparse precision matrix estimation with missing observations 2022 Ning Zhang
Yang Jin
+ PDF Chat A Unified Algorithmic Framework of Symmetric Gauss-Seidel Decomposition Based Proximal Admms for Convex Composite Programming 2019 Liang Chen sci
+ PDF Chat Convergence rates for an inexact ADMM applied to separable convex optimization 2020 William W. Hager
Hongchao Zhang
+ Operator Splitting Performance Estimation: Tight contraction factors and optimal parameter selection 2018 Ernest K. Ryu
Adrien Taylor
Carolina Bergeling
Pontus Giselsson
+ Unified linear convergence of first-order primal-dual algorithms for saddle point problems 2022 Fan Jiang
Zhongming Wu
Xingju Cai
Hongchao Zhang
+ A Superlinearly Convergent Splitting Feasible Sequential Quadratic Optimization Method for Two-Block Large-Scale Smooth Optimization 2022 Jinbao Jian
Chen Zhang
Pengjie Liu
+ A dual based semismooth Newton method for a class of sparse Tikhonov regularization 2020 Ning Zhang
+ Discerning the Linear Convergence of ADMM for Structured Convex Optimization through the Lens of Variational Analysis 2020 Xiaoming Yuan
Shangzhi Zeng
Jin Zhang
+ An incremental aggregated proximal ADMM for linearly constrained nonconvex optimization with application to sparse logistic regression problems 2021 Zehui Jia
Jieru Huang
Zhongming Wu
+ On the characterizations of solutions to perturbed <i>l</i><sub>1</sub> conic optimization problem 2019 Yong-Jin Liu
Ruonan Li
Bo Wang