Lottery Ticket Implies Accuracy Degradation, Is It a Desirable Phenomenon?

Ning Liu, Geng Yuan, Zhengping Che, Xuan Shen, Xiaolong Ma, Qing Jin, Jian Ren, Jian Tang, Sijia Liu, Yanzhi Wang

Type: Preprint

Publication Date: 2021-02-19

Citations: 1

Locations

arXiv (Cornell University) - View

Similar Works

Action	Title	Year	Authors
+	Lottery Ticket Preserves Weight Correlation: Is It Desirable or Not?	2021	Ning Liu Geng Yuan Zhengping Che Xuan Shen Xiaolong Ma Qing Jin Jian Ren Jian Tang Sijia Liu Yanzhi Wang
+	Lottery Ticket Preserves Weight Correlation: Is It Desirable or Not?	2021	Ning Liu Geng Yuan Zhengping Che Xuan Shen Xiaolong Ma Qing Jin Jian Ren Jian Tang Sijia Liu Yanzhi Wang
+	The Elastic Lottery Ticket Hypothesis	2021	Xiaohan Chen Yu Cheng Shuohang Wang Zhe Gan Jingjing Liu Zhangyang Wang
+	Efficient Lottery Ticket Finding: Less Data is More	2021	Zhenyu Zhang Xuxi Chen Tianlong Chen Zhangyang Wang
+	The Elastic Lottery Ticket Hypothesis	2021	Xiaohan Chen Yu Cheng Shuohang Wang Zhe Gan Jingjing Liu Zhangyang Wang
+	Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Sparse Neural Networks	2021	Shuai Zhang Meng Wang Sijia Liu Pin‐Yu Chen Jinjun Xiong
+	Dual Lottery Ticket Hypothesis	2022	Yue Bai Huan Wang Zhiqiang Tao Kunpeng Li Yun Fu
+	Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot?	2021	Xiaolong Ma Geng Yuan Xuan Shen Tianlong Chen Xuxi Chen Xiaohan Chen Ning Liu Minghai Qin Sijia Liu Zhangyang Wang
+ PDF Chat	A Survey of Lottery Ticket Hypothesis	2024	Bohan Liu Zijie Zhang Peixiong He Zhensen Wang Yang Xiao Ruimeng Ye Yang Zhou Wei-Shinn Ku Bo Hui
+	The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks.	2019	Jonathan Frankle Michael Carbin
+	The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks	2018	Jonathan Frankle Michael Carbin
+	COLT: Cyclic Overlapping Lottery Tickets for Faster Pruning of Convolutional Neural Networks	2022	Ismail Hossain Mohammed Rakib M. M. Lutfe Elahi Nabeel Mohammed Shafin Rahman
+	Sanity Checks for Lottery Tickets: Does Your Winning Ticket Really Win the Jackpot?	2021	Xiaolong Ma Geng Yuan Xuan Shen Tianlong Chen Xuxi Chen Xiaohan Chen Ning Liu Minghai Qin Sijia Liu Zhangyang Wang
+	Multi-Prize Lottery Ticket Hypothesis: Finding Accurate Binary Neural Networks by Pruning A Randomly Weighted Network	2021	James Diffenderfer Bhavya Kailkhura
+	Provably Efficient Lottery Ticket Discovery	2021	C. Wolfe Qihan Wang Junhyung Lyle Kim Anastasios Kyrillidis
+	Lottery Jackpots Exist in Pre-trained Models	2021	Yuxin Zhang Mingbao Lin Fei Chao Yan Wang Yongjian Wu Feiyue Huang Mingliang Xu Yonghong Tian Rongrong Ji
+	Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks	2021	Shuai Zhang Meng Wang Sijia Liu Pin‐Yu Chen Jinjun Xiong
+ PDF Chat	Lottery Jackpots Exist in Pre-Trained Models	2023	Yuxin Zhang Mingbao Lin Yunshan Zhong Fei Chao Rongrong Ji
+	Winning the Lottery with Continuous Sparsification	2020	Pedro Savarese Hugo Silva Michael Maire
+	Winning the Lottery with Continuous Sparsification	2019	Pedro Savarese Hugo Silva Michael Maire

Works That Cite This (1)

Action	Title	Year	Authors
+ PDF Chat	Recent Advances on Neural Network Pruning at Initialization	2022	Huan Wang Can Qin Yue Bai Yulun Zhang Yun Fu

Works Cited by This (17)

Action	Title	Year	Authors
+	Very Deep Convolutional Networks for Large-Scale Image Recognition	2014	Karen Simonyan Andrew Zisserman
+	Systematic Weight Pruning of DNNs using Alternating Direction Method of Multipliers	2018	Tianyun Zhang Shaokai Ye Yipeng Zhang Yanzhi Wang Makan Fardad
+	The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks	2018	Jonathan Frankle Michael Carbin
+	2PFPCE: Two-Phase Filter Pruning Based on Conditional Entropy	2018	Chuhan Min Aosen Wang Yiran Chen Wenyao Xu Xin Chen
+ PDF Chat	Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration	2019	Yang He Ping Liu Ziwei Wang Zhilan Hu Yi Yang
+	One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers	2019	Ari S. Morcos Haonan Yu M. Paganini Yuandong Tian
+	Stabilizing the Lottery Ticket Hypothesis	2019	Jonathan Frankle Gintare Karolina Dziugaite Daniel M. Roy Michael Carbin
+	Rethinking the Value of Network Pruning	2018	Zhuang Liu Mingjie Sun Tinghui Zhou Gao Huang Trevor Darrell
+ PDF Chat	NeST: A Neural Network Synthesis Tool Based on a Grow-and-Prune Paradigm	2019	Xiaoliang Dai Hongxu Yin Niraj K. Jha
+ PDF Chat	Channel Pruning for Accelerating Very Deep Neural Networks	2017	Yihui He Xiangyu Zhang Jian Sun