Distributed linear regression by averaging

Edgar Dobriban, Yue Sheng

Type: Preprint

Publication Date: 2018-01-01

Citations: 14

DOI: https://doi.org/10.48550/arxiv.1810.00412

View Publication

Locations

arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	Distributed linear regression by averaging	2021	Edgar Dobriban Yue Sheng
+	WONDER: Weighted one-shot distributed ridge regression in high dimensions	2019	Edgar Dobriban Yue Sheng
+	WONDER: Weighted one-shot distributed ridge regression in high dimensions	2019	Edgar Dobriban Sheng Yue
+ PDF Chat	Optimizing the Optimal Weighted Average: Efficient Distributed Sparse Classification	2024	Fred Lu Ryan R. Curtin Edward Raff Francis Ferraro James Holt
+	Parallelizing Stochastic Gradient Descent for Least Squares Regression: mini-batching, averaging, and model misspecification	2016	Prateek Jain Sham M. Kakade Rahul Kidambi Praneeth Netrapalli Aaron Sidford
+	Selective Inference with Distributed Data	2023	Sifan Liu Snigdha Panigrahi
+	Parallelizing Stochastic Gradient Descent for Least Squares Regression: mini-batching, averaging, and model misspecification.	2016	Prateek Jain Sham M. Kakade Rahul Kidambi Praneeth Netrapalli Aaron Sidford
+ PDF Chat	Trade-Offs in Large-Scale Distributed Tuplewise Estimation And Learning	2020	Robin Vogel Aurélien Bellet Stéphan Clémençon Ons Jelassi Guillaume Papa
+	Communication-efficient distributed estimation for high-dimensional large-scale linear regression	2022	Zhan Liu Xiaoluo Zhao Yingli Pan
+	LOCO: Distributing Ridge Regression with Random Projections	2014	Christina Heinze Brian McWilliams Nicolai Meinshausen Gabriel Krummenacher
+	Distributed Online Linear Regression	2019	Deming Yuan Alexandre Proutière Guodong Shi
+	Distributed Stochastic Optimization via Adaptive Stochastic Gradient Descent.	2018	Ashok Cutkosky Róbert Busa‐Fekete
+	Local SGD in Overparameterized Linear Regression	2022	Mike Nguyen Charly Kirst Nicole Mücke
+	DUAL-LOCO: Distributing Statistical Estimation Using Random Projections	2015	Christina Heinze Brian McWilliams Nicolai Meinshausen
+	DUAL-LOCO: Distributing Statistical Estimation Using Random Projections	2015	Christina Heinze Brian McWilliams Nicolai Meinshausen
+	Communication-Efficient Distributed Optimization of Self-Concordant Empirical Loss	2015	Yuchen Zhang Lin Xiao
+	Parallelizing Stochastic Approximation Through Mini-Batching and Tail-Averaging.	2016	Prateek Jain Sham M. Kakade Rahul Kidambi Praneeth Netrapalli Aaron Sidford
+ PDF Chat	DSAG: A Mixed Synchronous-Asynchronous Iterative Method for Straggler-Resilient Learning	2022	Albin Severinson Eirik Rosnes Salim El Rouayheb Alexandre Graell i Amat
+ PDF Chat	DSAG: A mixed synchronous-asynchronous iterative method for straggler-resilient learning	2021	Albin Severinson Eirik Rosnes Salim El Rouayheb Alexandre Graell i Amat
+	DSAG: A mixed synchronous-asynchronous iterative method for straggler-resilient learning	2021	Albin Severinson Eirik Rosnes Salim El Rouayheb Alexandre Graell i Amat

Works That Cite This (13)

Action	Title	Year	Authors
+	What causes the test error? Going beyond bias-variance via ANOVA	2020	Licong Lin Edgar Dobriban
+	Sparse sketches with small inversion bias	2020	Michał Dereziński Zhenyu Liao Edgar Dobriban Michael W. Mahoney
+	Ridge Regression: Structure, Cross-Validation, and Sketching	2019	Sifan Liu Edgar Dobriban
+	High-Dimensional Linear Models: A Random Matrix Perspective	2020	Jamshid Namdari Debashis Paul Lili Wang
+	Distributed Adaptive Huber Regression	2021	Jiyu Luo Qiang Sun Wen‐Xin Zhou
+	How to reduce dimension with PCA and random projections?	2020	Fan Yang Sifan Liu Edgar Dobriban David P. Woodruff
+	Tracy-Widom limit for the largest eigenvalue of high-dimensional covariance matrices in elliptical distributions	2019	Jun Wen Zhou Wang
+	Ridge Regression: Structure, Cross-Validation, and Sketching	2020	Sifan Liu Edgar Dobriban
+	WONDER: Weighted one-shot distributed ridge regression in high dimensions	2019	Edgar Dobriban Yue Sheng
+ PDF Chat	ADAGES	2020	Yu Gui

Works Cited by This (46)

Action	Title	Year	Authors
+ PDF Chat	Spectral Analysis of Large Dimensional Random Matrices	2009	Zhidong Bai Jack W. Silverstein
+	Optimality guarantees for distributed statistical estimation	2014	John C. Duchi Michael I. Jordan Martin J. Wainwright Yuchen Zhang
+	No eigenvalues outside the support of the limiting empirical spectral distribution of a separable covariance matrix	2008	Debashis Paul Jack W. Silverstein
+	Divide and Conquer Kernel Ridge Regression	2013	Yuchen Zhang John C. Duchi Martin J. Wainwright
+ PDF Chat	Spectral convergence for a general class of random matrices	2011	Francisco R. Rubio Xavier Mestre
+	On Early Stopping in Gradient Descent Learning	2007	Yuan Yao Lorenzo Rosasco Andrea Caponnetto
+	All convex invariant functions of hermitian matrices	1957	Chandler Davis
+	DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES	1967	V A Marčenko L. А. Pastur
+	Random Matrix Theory and Wireless Communications	2004	Antonia M. Tulino Sergio Verdú
+ PDF Chat	Eigenvalue Distributions of Sums and Products of Large Random Matrices Via Incremental Matrix Expansions	2008	M.J.M. Peacock Iain B. Collings Michael L. Honig