Deeper Insights into Weight Sharing in Neural Architecture Search

Yuge Zhang, Zejun Lin, Junyang Jiang, Quanlu Zhang, Yujing Wang, Hui Xue, Chen Zhang, Yaming Yang

Type: Preprint

Publication Date: 2020-01-01

Citations: 37

DOI: https://doi.org/10.48550/arxiv.2001.01431

View Publication

Locations

arXiv (Cornell University) - View
DataCite API - View

Similar Works

Action	Title	Year	Authors
+ PDF Chat	Deeper Insights into Weight Sharing in Neural Architecture Search	2020	Yuge Zhang Zejun Lin Junyang Jiang Quanlu Zhang Yujing Wang Hui Xue Chen Zhang Yaming Yang
+	Analyzing and Mitigating Interference in Neural Architecture Search	2021	Jin Xu Xu Tan Kaitao Song Renqian Luo Yichong Leng Tao Qin Tie‐Yan Liu Jian Li
+	BETANAS: BalancEd TrAining and selective drop for Neural Architecture Search	2019	Muyuan Fang Qiang Wang Zhao Zhong
+	Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization Gap	2020	Lingxi Xie Xin Chen Kaifeng Bi Longhui Wei Yuhui Xu Zhengsu Chen Lanfei Wang An Xiao Jianlong Chang Xiaopeng Zhang
+ PDF Chat	Pi-NAS: Improving Neural Architecture Search by Reducing Supernet Training Consistency Shift	2021	Jiefeng Peng Jiqi Zhang Changlin Li Guangrun Wang Xiaodan Liang Liang Lin
+	Pi-NAS: Improving Neural Architecture Search by Reducing Supernet Training Consistency Shift	2021	Jiefeng Peng Jiqi Zhang Changlin Li Guangrun Wang Xiaodan Liang Liang Lin
+ PDF Chat	Pi-NAS: Improving Neural Architecture Search by Reducing Supernet Training Consistency Shift	2021	Jiefeng Peng Jiqi Zhang Changlin Li Guangrun Wang Xiaodan Liang Liang Lin
+	SCARLET-NAS: Bridging the Gap between Stability and Scalability in Weight-sharing Neural Architecture Search	2019	Xiangxiang Chu Bo Zhang Jixiang Li Qingyuan Li Ruijun Xu
+	FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search	2019	Xiangxiang Chu Bo Zhang Ruijun Xu Jixiang Li
+ PDF Chat	FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search	2021	Xiangxiang Chu Bo Zhang Ruijun Xu
+ PDF Chat	SCARLET-NAS: Bridging the Gap between Stability and Scalability in Weight-sharing Neural Architecture Search	2021	Xiangxiang Chu Bo Zhang Qingyuan Li Ruijun Xu Xudong Li
+	How Does Supernet Help in Neural Architecture Search?	2020	Yuge Zhang Quanlu Zhang Yaming Yang
+ PDF Chat	How Does Supernet Help in Neural Architecture Search?	2020	Yuge Zhang Quanlu Zhang Yaming Yang
+	WPNAS: Neural Architecture Search by jointly using Weight Sharing and Predictor	2022	Ke Lin A Yong Zhuoxin Gan Yingying Jiang
+	Improving Ranking Correlation of Supernet with Candidates Enhancement and Progressive Training	2021	Ziwei Yang Ruyi Zhang Zhi Yang Xubo Yang Lei Wang Zheyang Li
+ PDF Chat	AdvantageNAS: Efficient Neural Architecture Search with Credit Assignment	2021	Rei Sato Jun Sakuma Youhei Akimoto
+	AdvantageNAS: Efficient Neural Architecture Search with Credit Assignment	2020	Rei Sato Jun Sakuma Youhei Akimoto
+	To Share or Not To Share: A Comprehensive Appraisal of Weight-Sharing	2020	Aloïs Pourchot Alexis Ducarouge Olivier Sigaud
+	Prior-Guided One-shot Neural Architecture Search	2022	Peijie Dong Xin Niu Lujun Li Linzhen Xie Wenbin Zou Tian Ye Zimian Wei Hengyue Pan
+	Progressive Automatic Design of Search Space for One-Shot Neural Architecture Search	2020	Xin Xia Xuefeng Xiao Xing Wang Min Zheng

Works That Cite This (26)

Action	Title	Year	Authors
+ PDF Chat	When NAS Meets Robustness: In Search of Robust Architectures Against Adversarial Attacks	2020	Minghao Guo Yuzhe Yang Rui Xu Ziwei Liu Dahua Lin
+	Disentangling Neural Architectures and Weights: A Case Study in Supervised Classification	2020	Nicolò Colombo Yang Gao
+ PDF Chat	Robustifying DARTS by Eliminating Information Bypass Leakage via Explicit Sparse Regularization	2021	Jiuling Zhang Zhiming Ding
+	Powering One-shot Topological NAS with Stabilized Share-parameter Proxy	2020	Ronghao Guo Lin Chen Chuming Li Keyu Tian Ming Sun Lu Sheng Junjie Yan
+	Weight-Sharing Neural Architecture Search: A Battle to Shrink the Optimization Gap	2020	Lingxi Xie Xin Chen Kaifeng Bi Longhui Wei Yuhui Xu Zhengsu Chen Lanfei Wang An Xiao Jianlong Chang Xiaopeng Zhang
+	When NAS Meets Robustness: In Search of Robust Architectures against Adversarial Attacks	2019	Minghao Guo Yuzhe Yang Rui Xu Ziwei Liu Dahua Lin
+	Speeding up Deep Model Training by Sharing Weights and Then Unsharing	2021	Shuo Yang Le Hou Xiaodan Song Qiang Liu Denny Zhou
+	Initialization and Regularization of Factorized Neural Layers	2021	Mikhail Khodak Neil Tenenholtz Lester Mackey Nicolò Fusi
+	AceNAS: Learning to Rank Ace Neural Architectures with Weak Supervision of Weight Sharing.	2021	Yuge Zhang Chenqian Yan Quanlu Zhang Li Lyna Zhang Yaming Yang Xiaotian Gao Yuqing Yang
+	NAS-Bench-x11 and the Power of Learning Curves	2021	Yan Shen Colin White Yash Savani Frank Hutter

Works Cited by This (21)

Action	Title	Year	Authors
+	A NEW MEASURE OF RANK CORRELATION	1938	M. G. Kendall
+ PDF Chat	CNN Features Off-the-Shelf: An Astounding Baseline for Recognition	2014	Ali Sharif Razavian Hossein Azizpour Josephine Sullivan Stefan Carlsson
+	SGDR: Stochastic Gradient Descent with Warm Restarts	2016	Ilya Loshchilov Frank Hutter
+	Neural Architecture Search with Reinforcement Learning	2016	Barret Zoph Quoc V. Le
+	Designing Neural Network Architectures using Reinforcement Learning	2016	Bowen Baker Otkrist Gupta Nikhil Naik Ramesh Raskar
+ PDF Chat	Do Better ImageNet Models Transfer Better?	2019	Simon Kornblith Jonathon Shlens Quoc V. Le
+	You Only Search Once: Single Shot Neural Architecture Search via Direct Sparse Optimization	2018	Xinbang Zhang Zehao Huang Naiyan Wang
+	Random Search and Reproducibility for Neural Architecture Search	2019	Liam Li Ameet Talwalkar
+	Single Path One-Shot Neural Architecture Search with Uniform Sampling	2019	Zichao Guo Xiangyu Zhang Haoyuan Mu Wen Heng Zechun Liu Yichen Wei Jian Sun
+	Weight Agnostic Neural Networks	2019	Adam Gaier David Ha