EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization

Wei Shi, Qing Ling, Gang Wu, Wotao Yin

Type: Preprint

Publication Date: 2014-01-01

Citations: 11

DOI: https://doi.org/10.48550/arxiv.1404.6264

View Publication

Locations

arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization	2015	Wei Shi Qing Ling Gang Wu Wotao Yin
+	A Hessian inversion-free exact second order method for distributed consensus optimization	2022	Dušan Jakovetić Nataša Krejić Nataša Krklec Jerinkić
+ PDF Chat	A Hessian Inversion-Free Exact Second Order Method for Distributed Consensus Optimization	2022	Dušan Jakovetić Nataša Krejić Nataša Krklec Jerinkić
+	A Newton Tracking Algorithm with Exact Linear Convergence Rate for Decentralized Consensus Optimization	2020	Jiaojiao Zhang Qing Ling Anthony Man–Cho So
+	A Communication-Efficient Decentralized Newton's Method with Provably Faster Convergence	2022	Huikang Liu Jiaojiao Zhang Anthony Man–Cho So Qing Ling
+ PDF Chat	On the Convergence of Decentralized Gradient Descent	2016	Kun Yuan Qing Ling Wotao Yin
+	Decentralized Stochastic Variance Reduced Extragradient Method	2022	Luo Luo Haishan Ye
+	An Optimal Stochastic Algorithm for Decentralized Nonconvex Finite-sum Optimization	2022	Luo Luo Haishan Ye
+	Multi-consensus Decentralized Accelerated Gradient Descent	2020	Haishan Ye Luo Luo Ziang Zhou Tong Zhang
+	Gradient-Consensus Method for Distributed Optimization in Directed Networks	2019	Vivek Khatana Govind Saraswat Sourav Patel Murti V. Salapaka
+ PDF Chat	A Newton Tracking Algorithm with Exact Linear Convergence Rate for Decentralized Consensus Optimization	2020	Jiaojiao Zhang Qing Ling Anthony Man–Cho So
+ PDF Chat	A Zeroth-Order Proximal Algorithm for Consensus Optimization	2024	C. W. Wang Zichong Ou Jie Lu
+ PDF Chat	A Communication-Efficient Decentralized Newton's Method With Provably Faster Convergence	2023	Huikang Liu Jiaojiao Zhang Anthony Man–Cho So Qing Ling
+	A Fast Proximal Gradient Algorithm for Decentralized Composite Optimization over Directed Networks	2016	Jinshan Zeng Tao He Mingwen Wang
+ PDF Chat	A Unified and Refined Convergence Analysis for Non-Convex Decentralized Learning	2022	Sulaiman A. Alghunaim Kun Yuan
+	Decentralized Approximate Newton Methods for In-Network Optimization	2019	Hejie Wei Zhihai Qu Xuyang Wu Hao Wang Jie Lu
+	Adaptive Consensus: A network pruning approach for decentralized optimization	2023	Suhail M. Shah Albert S. Berahas Raghu Bollapragada
+	Decentralized Consensus Optimization With Asynchrony and Delays	2017	Tianyu Wu Kun Yuan Qing Ling Wotao Yin Ali H. Sayed
+	Decentralized Consensus Optimization with Asynchrony and Delays	2016	Tianyu Wu Kun Yuan Qing Ling Wotao Yin Ali H. Sayed
+	A general framework for decentralized optimization with first-order methods	2020	Ran Xin Shi Pu Angelia Nedić Usman A. Khan

Works That Cite This (7)

Action	Title	Year	Authors
+	Convergence Rate of Distributed ADMM over Networks	2016	Ali Makhdoumi Asuman Ozdaglar
+	NEXT: In-Network Nonconvex Optimization	2016	Paolo Di Lorenzo Gesualdo Scutari
+	Network Newton-Part I: Algorithm and Convergence	2015	Aryan Mokhtari Qing Ling Alejandro Ribeiro
+	Toward Creating Subsurface Camera	2018	Wen‐Zhan Song Fangyu Li Maria Valero Liang Zhao
+	Graph Balancing for Distributed Subgradient Methods over Directed Graphs	2016	Ali Makhdoumi Asuman Ozdaglar
+	A Coordinate Descent Primal-Dual Algorithm and Application to Distributed Asynchronous Optimization	2014	Pascal Bianchi Walid Hachem Franck Iutzeler
+	DQM: Decentralized Quadratically Approximated Alternating Direction Method of Multipliers	2016	Aryan Mokhtari Wei Shi Qing Ling Alejandro Ribeiro

Works Cited by This (16)

Action	Title	Year	Authors
+	Stochastic Gradient-Push for Strongly Convex Functions on Time-Varying Directed Graphs	2014	Angelia Nedić Alex Olshevsky
+ PDF Chat	Distributed Robust Power System State Estimation	2012	Vassilis Kekatos Georgios B. Giannakis
+ PDF Chat	Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization	2010	S. Sundhar Ram A. Nedić Venugopal V. Veeravalli
+ PDF Chat	Augmented $\ell_1$ and Nuclear-Norm Models with a Globally Linearly Convergent Algorithm	2013	Ming‐Jun Lai Wotao Yin
+ PDF Chat	Multi-Agent Distributed Optimization via Inexact Consensus ADMM	2014	Tsung‐Hui Chang Mingyi Hong Xiangfeng Wang
+ PDF Chat	On the Linear Convergence of the ADMM in Decentralized Consensus Optimization	2014	Wei Shi Qing Ling Kun Yuan Gang Wu Wotao Yin
+ PDF Chat	Fast Distributed Gradient Methods	2014	Dušan Jakovetić João Xavier José M. F. Moura
+ PDF Chat	Fastest Mixing Markov Chain on a Graph	2004	Stephen Boyd Persi Diaconis Lin Xiao
+	Distributed Sparse Linear Regression	2010	Gonzalo Mateos Juan Andrés Bazerque Georgios B. Giannakis
+ PDF Chat	On the O(1=k) convergence of asynchronous distributed alternating Direction Method of Multipliers	2013	Ermin Wei Asuman Ozdaglar