Reducing Communication in Proximal Newton Methods for Sparse Least Squares Problems

Saeed Soori, Aditya Devarakonda, Zachary Blanco, James Demmel, Mert Gürbüzbalaban, Maryam Mehri Dehnavi

Type: Article

Publication Date: 2018-08-08

Citations: 4

DOI: https://doi.org/10.1145/3225058.3225131

Similar Works

Action	Title	Year	Authors
+	Avoiding Communication in Proximal Methods for Convex Optimization Problems	2017	Saeed Soori Aditya Devarakonda James Demmel Mert Gürbüzbalaban Maryam Mehri Dehnavi
+ PDF Chat	Avoiding Synchronization in First-Order Methods for Sparse Convex Optimization	2018	Aditya Devarakonda Kimon Fountoulakis James Demmel Michael W. Mahoney
+	Avoiding Synchronization in First-Order Methods for Sparse Convex Optimization	2017	Aditya Devarakonda Kimon Fountoulakis James Demmel Michael W. Mahoney
+	Avoiding Synchronization in First-Order Methods for Sparse Convex Optimization	2017	Aditya Devarakonda Kimon Fountoulakis James Demmel Michael W. Mahoney
+ PDF Chat	HPC formulations of optimization algorithms for tensor completion	2017	Shaden Smith Jongsoo Park George Karypis
+	Efficient Implementation of Stochastic Proximal Point Algorithm for Matrix and Tensor Completion	2021	Aysegul Bumin Kejun Huang
+	An Exploration of Optimization Algorithms for High Performance Tensor Completion	2016	Shaden Smith Jongsoo Park George Karypis
+	An exploration of optimization algorithms for high performance tensor completion	2016	Shaden Smith Jongsoo Park George Karypis
+ PDF Chat	Avoiding Communication in Primal and Dual Block Coordinate Descent Methods	2019	Aditya Devarakonda Kimon Fountoulakis James Demmel Michael W. Mahoney
+	Breaking the Nonsmooth Barrier: A Scalable Parallel Method for Composite Optimization	2017	Fabián Pedregosa Rémi Leblond Simon Lacoste-Julien
+	signProx: One-Bit Proximal Algorithm for Nonconvex Stochastic Optimization	2018	Xiaojian Xu Ulugbek S. Kamilov
+ PDF Chat	SignProx: One-bit Proximal Algorithm for Nonconvex Stochastic Optimization	2019	Xiaojian Xu Ulugbek S. Kamilov
+	Communication-Avoiding Optimization Methods for Distributed Massive-Scale Sparse Inverse Covariance Estimation	2017	Penporn Koanantakool Alnur Ali Ariful Azad Aydın Buluç Dmitriy Morozov Leonid Oliker Katherine Yelick Sang‐Yun Oh
+	Communication-Avoiding Optimization Methods for Distributed Massive-Scale Sparse Inverse Covariance Estimation	2017	Penporn Koanantakool Alnur Ali Ariful Azad Aydın Buluç Dmitriy Morozov Leonid Oliker Katherine Yelick Sang‐Yun Oh
+	Anytime Stochastic Gradient Descent: A Time to Hear from all the Workers	2018	Nuwan S. Ferdinand Stark C. Draper
+ PDF Chat	Anytime Stochastic Gradient Descent: A Time to Hear from all the Workers	2018	Nuwan S. Ferdinand Stark C. Draper
+	Anytime Stochastic Gradient Descent: A Time to Hear from all the Workers	2018	Nuwan S. Ferdinand Stark C. Draper
+	Avoiding communication in primal and dual block coordinate descent methods	2016	Aditya Devarakonda Kimon Fountoulakis James Demmel Michael W. Mahoney
+ PDF Chat	LSRN: A Parallel Iterative Solver for Strongly Over- or Underdetermined Systems	2014	Xiangrui Meng Michael A. Saunders Michael W. Mahoney
+	GIANT: Globally Improved Approximate Newton Method for Distributed Optimization	2017	Shusen Wang Farbod Roosta-Khorasani Peng Xu Michael W. Mahoney

Cited by (2)

Action	Title	Year	Authors
+ PDF Chat	Avoiding Communication in Logistic Regression	2020	Aditya Devarakonda James Demmel
+	Composing Loop-carried Dependence with Other Loops	2021	Kazem Cheshmi Michelle Mills Strout Maryam Mehri Dehnavi

Citing (26)

Action	Title	Year	Authors
+	A distributed block coordinate descent method for training $l_1$ regularized linear classifiers	2014	Dhruv Mahajan S. Sathiya Keerthi S. Sundararajan
+	Blitz: A Principled Meta-Algorithm for Scaling Sparse Optimization	2015	Tyler Johnson Carlos Guestrin
+	Avoiding Communication in Nonsymmetric Lanczos-Based Krylov Subspace Methods	2013	Erin Carson Nicholas Knight James Demmel
+ PDF Chat	A Proximal Stochastic Gradient Method with Progressive Variance Reduction	2014	Lin Xiao Tong Zhang
+ PDF Chat	Incremental proximal methods for large scale convex optimization	2011	Dimitri P. Bertsekas
+	Parallel iterative S-step methods for unsymmetric linear systems	1996	A.T. Chronopoulos C.D. Swanson
+ PDF Chat	A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging	2010	Antonin Chambolle Thomas Pock
+	Regularization Paths for Generalized Linear Models via Coordinate Descent.	2010	Jerome H. Friedman Trevor Hastie Rob Tibshirani
+	Communication lower bounds and optimal algorithms for numerical linear algebra	2014	Grey Ballard Erin Carson James Demmel Mark Frederick Hoemmen Nicholas Knight Oded Schwartz
+	A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems	2009	Amir Beck Marc Teboulle
+ PDF Chat	An iterative thresholding algorithm for linear inverse problems with a sparsity constraint	2004	Ingrid Daubechies Michel Defrise Christine De Mol
+ PDF Chat	Templates for convex cone problems with applications to sparse signal recovery	2011	Stephen R. Becker Emmanuel J. Candès Michael C. Grant
+	Communication-Avoiding Krylov Subspace Methods in Theory and Practice	2015	Erin Carson
+ PDF Chat	Avoiding Communication in Primal and Dual Block Coordinate Descent Methods	2019	Aditya Devarakonda Kimon Fountoulakis James Demmel Michael W. Mahoney
+	Proximal Algorithms	2013	Neal Parikh Stephen Boyd
+ PDF Chat	Permuted and Augmented Stick-Breaking Bayesian Multinomial Regression	2016	Quan Zhang Mingyuan Zhou
+ PDF Chat	Proximal Newton-Type Methods for Minimizing Composite Functions	2014	Jason D. Lee Yuekai Sun Michael A. Saunders
+	A distributed block coordinate descent method for training $l_1$ regularized linear classifiers	2014	Dhruv Mahajan S. Sathiya Keerthi S. Sundararajan
+	Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decomposition	2015	Rong Ge Furong Huang Chi Jin Yuan Yang
+ PDF Chat	Coordinate descent algorithms for lasso penalized regression	2008	Tong Tong Wu Kenneth Lange
+	Regularization Paths for Generalized Linear Models via Coordinate Descent	2010	Jerome H. Friedman Trevor Hastie Robert Tibshirani
+ PDF Chat	Mini-Batch Semi-Stochastic Gradient Descent in the Proximal Setting	2015	Jakub Konečný Jie Liu Peter Richtárik Martin Takáč
+ PDF Chat	Communication-optimal Parallel and Sequential QR and LU Factorizations	2012	James Demmel Laura Grigori Mark Frederick Hoemmen Julien Langou
+	MLlib: Machine Learning in Apache Spark	2015	Xiangrui Meng Joseph K. Bradley Burak Yavuz Evan Sparks Shivaram Venkataraman Davies Liu Jeremy Freeman DB Tsai Manish Amde Sean Owen
+ PDF Chat	Avoiding Synchronization in First-Order Methods for Sparse Convex Optimization	2018	Aditya Devarakonda Kimon Fountoulakis James Demmel Michael W. Mahoney
+	Stochastic Proximal Gradient Consensus Over Random Networks	2017	Mingyi Hong Tsung‐Hui Chang