Generalized Leverage Score Sampling for Neural Networks

Jason Dean Lee, Ruoqi Shen, Zhao Song, Mengdi Wang, Yu Zheng

Type: Preprint

Publication Date: 2020-01-01

Citations: 18

DOI: https://doi.org/10.48550/arxiv.2009.09829

View Publication

Locations

arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	Generalized Leverage Score Sampling for Neural Networks	2020	Jason D. Lee Ruoqi Shen Zhao Song Mengdi Wang Zheng Yu
+	Random Features for the Neural Tangent Kernel	2021	In‐Su Han Haim Avron Neta Shoham Chaewon Kim Jinwoo Shin
+	On Fast Leverage Score Sampling and Optimal Learning	2018	Alessandro Rudi Daniele Calandriello Luigi Carratino Lorenzo Rosasco
+	Random Features for Kernel Approximation: A Survey on Algorithms, Theory, and Beyond	2021	Fanghui Liu Xiaolin Huang Yudong Chen Johan A. K. Suykens
+	Random Features for Kernel Approximation: A Survey on Algorithms, Theory, and Beyond	2020	Fanghui Liu Xiaolin Huang Yudong Chen Johan A. K. Suykens
+	On Sampling Random Features From Empirical Leverage Scores: Implementation and Theoretical Guarantees	2019	Shahin Shahrampour Soheil Kolouri
+	Fast Randomized Kernel Methods With Statistical Guarantees	2014	A. El Alaoui Michael W. Mahoney
+	Regularization Matters: Generalization and Optimization of Neural Nets v.s. their Induced Kernel	2018	Colin Wei Jason D. Lee Qiang Liu Tengyu Ma
+	Adaptive Sampling for Deep Learning via Efficient Nonparametric Proxies	2023	Shabnam Daghaghi Benjamin Coleman Benito Geordie Anshumali Shrivastava
+	Fast randomized kernel ridge regression with statistical guarantees	2015	A. El Alaoui Michael W. Mahoney
+	PHEW: Constructing Sparse Networks that Learn Fast and Generalize Well without Training Data	2020	Shreyas Malakarjun Patil Constantine Dovrolis
+ PDF Chat	How to Inverting the Leverage Score Distribution?	2024	Zhihang Li Zhao Song Weixin Wang Junze Yin Yu Zheng
+	Scaling Neural Tangent Kernels via Sketching and Random Features	2021	Amir Zandieh In‐Su Han Haim Avron Neta Shoham Chaewon Kim Jinwoo Shin
+	Near Input Sparsity Time Kernel Embeddings via Adaptive Sampling	2020	David P. Woodruff Amir Zandieh
+	Near Input Sparsity Time Kernel Embeddings via Adaptive Sampling	2020	David P. Woodruff Amir Zandieh
+	Provably Useful Kernel Matrix Approximation in Linear Time.	2016	Cameron Musco Christopher Musco
+	Neural Networks Efficiently Learn Low-Dimensional Representations with SGD	2022	Alireza Mousavi-Hosseini Sejun Park Manuela Girotti Ioannis Mitliagkas Murat A. Erdogdu
+	A General Scoring Rule for Randomized Kernel Approximation with Application to Canonical Correlation Analysis	2019	Yinsong Wang Shahin Shahrampour
+	MAST: Model-Agnostic Sparsified Training	2023	Yury Demidovich Grigory Malinovsky Egor Shulgin Peter Richtárik
+	Ridge Regression and Provable Deterministic Ridge Leverage Score Sampling	2018	Shannon R. McCurdy

Works That Cite This (13)

Action	Title	Year	Authors
+ PDF Chat	Fast Graph Neural Tangent Kernel via Kronecker Sketching	2022	Shunhua Jiang Yunze Man Zhao Song Zheng Yu Danyang Zhuo
+ PDF Chat	Algorithms and Hardness for Linear Algebra on Geometric Graphs	2020	Josh Alman Timothy Chu Aaron Schild Zhao Song
+	Algorithms and Hardness for Linear Algebra on Geometric Graphs	2020	Josh Alman Timothy Chu Aaron Schild Zhao Song
+	Metric Transforms and Low Rank Matrices via Representation Theory of the Real Hyperrectangle	2020	Josh Alman Timothy Chu Gary L. Miller Shyam Narayanan Mark Sellke Zhao Song
+	FL-NTK: A Neural Tangent Kernel-based Framework for Federated Learning Convergence Analysis	2021	Baihe Huang Xiaoxiao Li Zhao Song Xin Yang
+	Optimal Rates for Averaged Stochastic Gradient Descent under Neural Tangent Kernel Regime	2020	Atsushi Nitanda Taiji Suzuki
+	Deep Equals Shallow for ReLU Networks in Kernel Regimes	2020	Alberto Bietti Francis Bach
+	MixCon: Adjusting the Separability of Data Representations for Harder Data Recovery	2020	Xiaoxiao Li Yangsibo Huang Binghui Peng Zhao Song Kai Li
+	Fast Sketching of Polynomial Kernels of Polynomial Degree	2021	Zhao Song David P. Woodruff Zheng Yu Lichen Zhang
+ PDF Chat	How to Protect Copyright Data in Optimization of Large Language Models?	2024	Timothy Chu Zhao Song Chiwun Yang

Works Cited by This (0)

Action	Title	Year	Authors