Shake-Shake regularization

Xavier Gastaldi

Type: Preprint

Publication Date: 2017-01-01

Citations: 342

DOI: https://doi.org/10.48550/arxiv.1705.07485

View Publication

Locations

arXiv (Cornell University) - View
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	ShakeDrop regularization	2018	Yoshihiro Yamada Masakazu Iwamura Koichi Kise
+	Swapout: Learning an ensemble of deep architectures	2016	Saurabh Singh Derek Hoiem David Forsyth
+	Swapout: learning an ensemble of deep architectures	2016	Saurabh Singh Derek Hoiem David Forsyth
+	A Bregman Learning Framework for Sparse Neural Networks.	2021	Leon Bungert Tim Roith Daniel Tenbrinck Martin Burger
+	A Bregman Learning Framework for Sparse Neural Networks	2021	Leon Bungert Tim Roith Daniel Tenbrinck Martin Burger
+	Shakedrop Regularization for Deep Residual Learning	2019	Yoshihiro Yamada Masakazu Iwamura Takuya Akiba Koichi Kise
+	Shakeout: A New Approach to Regularized Deep Neural Network Training	2019	Guoliang Kang Jun Li Dacheng Tao
+	Neuro-Inspired Deep Neural Networks with Sparse, Strong Activations	2022	Metehan Cekic Can Bakiskan Upamanyu Madhow
+	Bridgeout: stochastic bridge regularization for deep neural networks	2018	Najeeb Khan Jawad Ali Shah Ian Stavness
+	Bridgeout: stochastic bridge regularization for deep neural networks	2018	Najeeb Alam Khan Jawad Ali Shah Ian Stavness
+	The Shattered Gradients Problem: If resnets are the answer, then what is the question?	2017	David Balduzzi Marcus Frean Lennox Leary John Lewis Wan-Duo Kurt Brian McWilliams
+ PDF Chat	Shakeout: A New Approach to Regularized Deep Neural Network Training	2017	Guoliang Kang Jun Li Dacheng Tao
+	batchboost: regularization for stabilizing training with resistance to underfitting & overfitting	2020	Maciej A. Czyzewski
+	batchboost: regularization for stabilizing training with resistance to underfitting & overfitting	2020	Maciej A. Czyzewski
+	Regularization for Deep Learning: A Taxonomy	2017	Jan Kukačka Vladimir Golkov Daniel Cremers
+	Regularization for Deep Learning: A Taxonomy	2017	Jan Kukačka Vladimir Golkov Daniel Cremers
+	Averaging Weights Leads to Wider Optima and Better Generalization	2018	Pavel Izmailov D. A. Podoprikhin Timur Garipov Dmitry Vetrov Andrew Gordon Wilson
+	DropBlock: A regularization method for convolutional networks	2018	Golnaz Ghiasi Tsung-Yi Lin Quoc V. Le
+	PatchUp: A Regularization Technique for Convolutional Neural Networks	2020	Mojtaba Faramarzi Mohammad Reza Amini Akilesh Badrinaaraayanan Vikas Verma Sarath Chandar
+	Training Deep Networks from Zero to Hero: avoiding pitfalls and going beyond	2021	Moacir Antonelli Ponti Fernando Pereira dos Santos Leo Sampaio Ferraz Ribeiro Gabriel B. Cavallari

Works That Cite This (240)

Action	Title	Year	Authors
+ PDF Chat	XferNAS: Transfer Neural Architecture Search	2021	Martin Wistuba
+ PDF Chat	LA3: Efficient Label-Aware AutoAugment	2022	Mingjun Zhao Shan Lu Zixuan Wang Xiaoli Wang Di Niu
+	A Survey on Semi-, Self- and Unsupervised Learning for Image Classification	2021	Lars Schmarje Monty Santarossa Simon-Martin Schröder Reinhard Koch
+ PDF Chat	Snapshot Distillation: Teacher-Student Optimization in One Generation	2019	Chenglin Yang Lingxi Xie Chi Su Alan Yuille
+	Improved Mixed-Example Data Augmentation	2019	Cecilia Summers Michael J. Dinneen
+ PDF Chat	Human Uncertainty Makes Classification More Robust	2019	Joshua Peterson Ruairidh M. Battleday Thomas L. Griffiths Olga Russakovsky
+	Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules	2019	Daniel E. Ho Eric Liang Ion Stoica Pieter Abbeel Xi Chen
+	Neural SDE: Stabilizing Neural ODE Networks with Stochastic Noise	2019	Xuanqing Liu Tesi Xiao Si Si Cao Qin Sanjiv Kumar Cho‐Jui Hsieh
+	Efficient Multi-objective Neural Architecture Search via Lamarckian Evolution	2018	Thomas Elsken Jan Hendrik Metzen Frank Hutter
+	CIFAR10 to Compare Visual Recognition Performance between Deep Neural Networks and Humans.	2018	Tien Ho-Phuoc

Works Cited by This (13)

Action	Title	Year	Authors
+ PDF Chat	ImageNet Large Scale Visual Recognition Challenge	2015	Olga Russakovsky Jia Deng Hao Su Jonathan Krause Sanjeev Satheesh Sean Ma Zhiheng Huang Andrej Karpathy Aditya Khosla Michael S. Bernstein
+ PDF Chat	Deep Residual Learning for Image Recognition	2016	Kaiming He Xiangyu Zhang Shaoqing Ren Jian Sun
+	Adding Gradient Noise Improves Learning for Very Deep Networks	2015	Arvind Neelakantan Luke Vilnis Quoc V. Le Ilya Sutskever Łukasz Kaiser Karol Kurach James Martens
+	Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning	2016	Christian Szegedy Sergey Ioffe Vincent Vanhoucke Alexander A. Alemi
+ PDF Chat	Identity Mappings in Deep Residual Networks	2016	Kaiming He Xiangyu Zhang Shaoqing Ren Jian Sun
+	FractalNet: Ultra-Deep Neural Networks without Residuals	2016	Gustav Larsson Michael Maire Gregory Shakhnarovich
+	Densely Connected Convolutional Networks	2016	Gao Huang Zhuang Liu Laurens van der Maaten Kilian Q. Weinberger
+	SGDR: Stochastic Gradient Descent with Warm Restarts	2016	Ilya Loshchilov Frank Hutter
+	Multi-Residual Networks: Improving the Speed and Accuracy of Residual Networks	2016	Masoud Abdi Saeid Nahavandi
+	Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift	2015	Sergey Ioffe Christian Szegedy