DSA: More Efficient Budgeted Pruning via Differentiable Sparsity Allocation

Xuefei Ning, Tianchen Zhao, Wenshuo Li, Peng Lei, Yu Wang, Huazhong Yang

Type: Book-Chapter

Publication Date: 2020-01-01

Citations: 75

DOI: https://doi.org/10.1007/978-3-030-58580-8_35

View Publication

Download PDF

Locations

Lecture notes in computer science - View
arXiv (Cornell University) - View - PDF

Similar Works

Action	Title	Year	Authors
+	Exploring Sparsity via Convex Optimization Problems and Algorithms	2016	Ying Sun Daniel P. Palomar
+	Separating variables to accelerate non-convex regularized optimization	2020	Wenchen Liu Yincai Tang Xianyi Wu
+ PDF Chat	Optimization with Sparsity-Inducing Penalties	2011	Francis Bach Rodolphe Jenatton Julien Mairal Guillaume Obozinski
+	An Alternating Method for Cardinality-Constrained Optimization: A Computational Study for the Best Subset Selection and Sparse Portfolio Problems	2022	Carina Moreira Costa Dennis Kreber Martin Schmidt
+	Reduced complexity methods for large-scale convex optimization	2012	Anatoli Juditsky Arkadi Nemirovski
+	Sparse and Structured Optimization	2010	Stephen J. Wright
+	Sparsity penalized mean–variance portfolio selection: analysis and computation	2024	Bodhisattva Sen Deniz Akkaya Mustafa Ç. Pınar
+ PDF Chat	Acceleration by stepsize hedging: Silver Stepsize Schedule for smooth convex optimization	2024	Jason M. Altschuler Pablo A. Parrilo
+ PDF Chat	A Global Optimization Approach for Rational Sparsity Promoting Criteria	2018	Marc Castella Jean‐Christophe Pesquet
+	Practical Enhancements in Sequential Quadratic Optimization: Infeasibility Detection, Subproblem Solvers, and Penalty Parameter Updates	2015	Hao Wang
+	An overview of sparse convex optimization	2018	Jacob Mantjitji Modiba
+	Decomposition in derivative-free optimization	2021	Kaiwen Ma Nikolaos V. Sahinidis Sreekanth Rajagopalan Satyajith Amaran Scott J. Bury
+ PDF Chat	Optimal Non-Linear Models for Sparsity and Sampling	2008	Akram Aldroubi Carlos Cabrelli Ursula Molter
+	Second-Order Step-Size Tuning of SGD for Non-Convex Optimization	2022	Camille Castera Jérôme Bolte Cédric Févotte Edouard Pauwels
+	An ADM-based splitting method for separable convex programming	2012	Deren Han Xiaoming Yuan Wenxing Zhang Xingju Cai
+	Sparse Approximation and Optimization in High-Dimensions	2009
+	Sparse recovery by non-convex optimization – instance optimality	2009	Rayan Saab Özgür Yılmaz
+	A Survey on Regularized Sparse Optimization Models and Algorithms	2023	克林程
+	Advances in Low-Memory Subgradient Optimization	2020	Pavel Dvurechensky Alexander Gasnikov E. A. Nurminskii Fedor Stonyakin
+	Elimination dynamique : accélération des algorithmes d'optimisation convexe pour les régressions parcimonieuses	2016	Antoine Bonnefoy

Works That Cite This (30)

Action	Title	Year	Authors
+	Carrying out CNN Channel Pruning in a White Box	2021	Yuxin Zhang Mingbao Lin Chia‐Wen Lin Jie Chen Feiyue Huang Yongjian Wu Yonghong Tian Rongrong Ji
+	Channel Pruning in a White Box for Efficient Image Classification	2021	Yuxin Zhang Mingbao Lin Chia‐Wen Lin Jie Chen Feiyue Huang Yongjian Wu Yonghong Tian Rongrong Ji
+ PDF Chat	Ensemble Knowledge Guided Sub-network Search and Fine-Tuning for Filter Pruning	2022	Seunghyun Lee Byung Cheol Song
+ PDF Chat	Carrying Out CNN Channel Pruning in a White Box	2022	Yuxin Zhang Mingbao Lin Chia‐Wen Lin Jie Chen Yongjian Wu Yonghong Tian Rongrong Ji
+	Architecture Aware Latency Constrained Sparse Neural Networks	2021	Tianli Zhao Qinghao Hu Xiangyu He Weixiang Xu Jiaxing Wang Cong Leng Jian Cheng
+ PDF Chat	GhostNets on Heterogeneous Devices via Cheap Operations	2022	Kai Han Yunhe Wang Chang Xu Jianyuan Guo Chunjing Xu Enhua Wu Qi Tian
+ PDF Chat	Self-supervised feature-gate coupling for dynamic network pruning	2024	Mengnan Shi Chang Liu Jianbin Jiao Qixiang Ye
+ PDF Chat	Towards Efficient Tensor Decomposition-Based DNN Model Compression with Optimization Framework	2021	Miao Yin Yang Sui Siyu Liao Bo Yuan
+ PDF Chat	Manifold Regularized Dynamic Network Pruning	2021	Yehui Tang Yunhe Wang Yixing Xu Yiping Deng Chao Xu Dacheng Tao Chang Xu
+ PDF Chat	BATUDE: Budget-Aware Neural Network Compression Based on Tucker Decomposition	2022	Miao Yin Huy Phan Xiao Zang Siyu Liao Bo Yuan

Works Cited by This (17)

Action	Title	Year	Authors
+	Learning Structured Sparsity in Deep Neural Networks	2016	Wei Wen Chunpeng Wu Yandan Wang Yiran Chen Hai Li
+	Pruning Filters for Efficient ConvNets	2016	Hao Li Asim Kadav Igor Đurđanović Hanan Samet Hans Peter Graf
+ PDF Chat	More is Less: A More Complicated Network with Less Inference Complexity	2017	Xuanyi Dong Junshi Huang Yi Yang Shuicheng Yan
+	Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks	2018	Yang He Guoliang Kang Xuanyi Dong Yanwei Fu Yi Yang
+ PDF Chat	AMC: AutoML for Model Compression and Acceleration on Mobile Devices	2018	Yihui He Ji Lin Zhijian Liu Hanrui Wang Li-Jia Li Song Han
+	MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning	2019	Zechun Liu Haoyuan Mu Xiangyu Zhang Zichao Guo Xin Yang Kwang‐Ting Cheng Jian Sun
+ PDF Chat	Filter Pruning via Geometric Median for Deep Convolutional Neural Networks Acceleration	2019	Yang He Ping Liu Ziwei Wang Zhilan Hu Yi Yang
+ PDF Chat	Learning Efficient Convolutional Networks through Network Slimming	2017	Zhuang Liu Jianguo Li Zhiqiang Shen Gao Huang Shoumeng Yan Changshui Zhang
+ PDF Chat	NetAdapt: Platform-Aware Neural Network Adaptation for Mobile Applications	2018	Tien-Ju Yang Andrew Howard Bo Chen Xiao Zhang Alec Go Mark Sandler Vivienne Sze Hartwig Adam
+ PDF Chat	Channel Pruning for Accelerating Very Deep Neural Networks	2017	Yihui He Xiangyu Zhang Jian Sun