Training Recommender Systems at Scale: Communication-Efficient Model and Data Parallelism

Vipul Gupta, Dhruv Choudhary, Ping Tang, Xiaohan Wei, Xing Wang, Yuzhen Huang, Arun Kejariwal, Kannan Ramchandran, Michael W. Mahoney

Type: Preprint

Publication Date: 2020-10-18

Citations: 0

Similar Works

Action	Title	Year	Authors
+	None	1999	Ming Liao
+	None	2001	I. N. Kostin
+	None	1999	Yong-Gao Chen Imre Z. Ruzsa
+	None	2003	Paul Sablonnière
+	None	2001	Emmanuel Fragnière Jacek Gondzio Robert Sarkissian
+	None	1998	G. Sardanashvily
+	None	1998	Hans Keiding
+	None	2003	Haihua Feng Vincenzo Galdi David A. Castañón
+	None	2003	V. Z. Kanchukoev B. S. Karamurzov В. А. Созаев Vladimir Chernov
+	None	2001	Petr Habala Nicole Tomczak-Jaegermann
+	None	2001	S. E. Kozlov
+ PDF Chat	None	2008	田村直義
+	None	2001	Joaquin Soriano
+	None	2001	Shigetaka Fukuda
+	None	2003	Solomon Friedberg
+	None	2003	Igor Belegradek
+	None	1997	Salih Çelïk
+	None	2001	M. de Montigny Hubert de Guise
+	None	2001	A. Yu. Kolesov Н. Х. Розов
+	None	2002	D. G. Djumbayeva Erlan Nursultanov

Action	Title	Year	Authors

Action	Title	Year	Authors
+ PDF Chat	Approximate computation and implicit regularization for very large-scale data analysis	2012	Michael W. Mahoney
+	Sketching as a Tool for Numerical Linear Algebra	2014	David P. Woodruff
+	Revisiting Distributed Synchronous SGD	2017	Jianmin Chen Rajat Monga Samy Bengio Rafał Józefowicz
+ PDF Chat	An Optimization Approach to Locally-Biased Graph Algorithms	2017	Kimon Fountoulakis David F. Gleich Michael W. Mahoney
+	Train longer, generalize better: closing the generalization gap in large batch training of neural networks	2017	Elad Hoffer Itay Hubara Daniel Soudry
+	Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour	2017	Priya Goyal Piotr Dollár Ross Girshick Pieter Noordhuis Lukasz Wesolowski Aapo Kyrola Andrew Tulloch Yangqing Jia Kaiming He
+	Scaling SGD Batch Size to 32K for ImageNet Training.	2017	Yang You Igor Gitman Boris Ginsburg
+	Don't Decay the Learning Rate, Increase the Batch Size	2017	Samuel Smith Pieter-Jan Kindermans Chris Ying Quoc V. Le
+	QSGD: Communication-Efficient SGD via Gradient Quantization and Encoding	2016	Dan Alistarh Demjan Grubic Jerry Li Ryota Tomioka Milan Vojnović
+	AdaBatch: Adaptive Batch Sizes for Training Deep Neural Networks	2017	Aditya Devarakonda Maxim Naumov Michael Garland