Differentiable Learning-to-Normalize via Switchable Normalization

Ping Luo, Jiamin Ren, Zhanglin Peng, Ruimao Zhang, Jingyu Li

Type: Preprint

Publication Date: 2018-01-01

Citations: 133

DOI: https://doi.org/10.48550/arxiv.1806.10779

View Publication

Locations

arXiv (Cornell University) - View - PDF
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	Switchable Normalization for Learning-to-Normalize Deep Representation	2019	Ping Luo Ruimao Zhang Jiamin Ren Zhanglin Peng Jingyu Li
+ PDF Chat	Switchable Normalization for Learning-to-Normalize Deep Representation	2019	Ping Luo Ruimao Zhang Jiamin Ren Zhanglin Peng Jingyu Li
+ PDF Chat	SSN: Learning Sparse Switchable Normalization via SparsestMax	2019	Wenqi Shao Tianjian Meng Jingyu Li Ruimao Zhang Yudian Li Xiaogang Wang Ping Luo
+	SSN: Learning Sparse Switchable Normalization via SparsestMax	2019	Wenqi Shao Tianjian Meng Jingyu Li Ruimao Zhang Yudian Li Xiaogang Wang Ping Luo
+	Beyond BatchNorm: Towards a General Understanding of Normalization in Deep Learning	2021	Ekdeep Singh Lubana Robert P. Dick Hidenori Tanaka
+	Beyond BatchNorm: Towards a Unified Understanding of Normalization in Deep Learning	2021	Ekdeep Singh Lubana Robert P. Dick Hidenori Tanaka
+	Do Normalization Layers in a Deep ConvNet Really Need to Be Distinct?	2018	Ping Luo Zhanglin Peng Jiamin Ren Ruimao Zhang
+	Accelerating Training of Deep Neural Networks with a Standardization Loss	2019	Jasmine Collins Johannes Ballé Jonathon Shlens
+	Four Things Everyone Should Know to Improve Batch Normalization	2020	Cecilia Summers Michael J. Dinneen
+	Self-Normalizing Neural Networks	2017	Günter Klambauer Thomas Unterthiner Andreas Mayr Sepp Hochreiter
+	Four Things Everyone Should Know to Improve Batch Normalization	2019	Cecilia Summers Michael J. Dinneen
+	Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift	2015	Sergey Ioffe Christian Szegedy
+	Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift	2015	Sergey Ioffe Christian Szegedy
+	NoMorelization: Building Normalizer-Free Models from a Sample's Perspective	2022	Chang Liu Yuwen Yang Yue Ding Hongtao Lu
+	Batch Normalization with Enhanced Linear Transformation	2020	Yuhui Xu Lingxi Xie Cihang Xie Jieru Mei Siyuan Qiao Wei Shen Hongkai Xiong Alan Yuille
+ PDF Chat	Normalization Techniques in Training DNNs: Methodology, Analysis and Application	2023	Lei Huang Jie Qin Yi Zhou Fan Zhu Li Liu Ling Shao
+	Normalization Techniques in Training DNNs: Methodology, Analysis and Application	2020	Lei Huang Jie Qin Yi Zhou Fan Zhu Li Liu Ling Shao
+	Instance-Level Meta Normalization	2019	Songhao Jia Ding-Jie Chen Hwann-Tzong Chen
+	Self-Normalizing Neural Networks	2017	Günter Klambauer Thomas Unterthiner Andreas Mayr Sepp Hochreiter
+	Rethinking Normalization and Elimination Singularity in Neural Networks	2019	Siyuan Qiao Huiyu Wang Chenxi Liu Wei Shen Alan Yuille

Works That Cite This (57)

Action	Title	Year	Authors
+	Group Whitening: Balancing Learning Efficiency and Representational Capacity	2020	Lei Huang Yi Zhou Li Liu Fan Zhu Ling Shao
+	An Investigation into the Stochasticity of Batch Whitening	2020	Lei Huang Lei Zhao Yi Zhou Fan Zhu Li Liu Ling Shao
+ PDF Chat	Automatic ischemic stroke lesion segmentation from computed tomography perfusion images by image synthesis and attention-based deep neural networks	2020	Guotai Wang Tao Song Qiang Dong Mei Cui Ning Huang Shaoting Zhang
+	Positional Normalization.	2019	Boyi Li Felix Wu Kilian Q. Weinberger Serge Belongie
+	Rethinking Normalization and Elimination Singularity in Neural Networks	2019	Siyuan Qiao Huiyu Wang Chenxi Liu Wei Shen Alan Yuille
+	Object Detection from Scratch with Deep Supervision	2018	Zhiqiang Shen Zhuang Liu Jianguo Li Yu–Gang Jiang Yurong Chen Xiangyang Xue
+ PDF Chat	Style Normalization and Restitution for Generalizable Person Re-Identification	2020	Xin Jin Cuiling Lan Wenjun Zeng Zhibo Chen Li Zhang
+ PDF Chat	Delving into the Estimation Shift of Batch Normalization in a Network	2022	Lei Huang Yi Zhou Tian Wang Jie Luo Xianglong Liu
+ PDF Chat	Exemplar Normalization for Learning Deep Representation	2020	Ruimao Zhang Zhanglin Peng Ling‐Yun Wu Zhen Li Ping Luo
+ PDF Chat	An Investigation Into the Stochasticity of Batch Whitening	2020	Lei Huang Lei Zhao Yi Zhou Fan Zhu Li Liu Ling Shao

Works Cited by This (27)

Action	Title	Year	Authors
+	Very Deep Convolutional Networks for Large-Scale Image Recognition	2014	Karen Simonyan Andrew Zisserman
+	Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift	2015	Sergey Ioffe Christian Szegedy
+ PDF Chat	ImageNet Large Scale Visual Recognition Challenge	2015	Olga Russakovsky Jia Deng Hao Su Jonathan Krause Sanjeev Satheesh Sean Ma Zhiheng Huang Andrej Karpathy Aditya Khosla Michael S. Bernstein
+ PDF Chat	An overview of bilevel optimization	2007	Benoît Colson Patrice Marcotte Gilles Savard
+ PDF Chat	Deep Residual Learning for Image Recognition	2016	Kaiming He Xiangyu Zhang Shaoqing Ren Jian Sun
+	Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks	2016	Tim Salimans Diederik P. Kingma
+ PDF Chat	Perceptual Losses for Real-Time Style Transfer and Super-Resolution	2016	Justin Johnson Alexandre Alahi Li Fei-Fei
+ PDF Chat	DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs	2017	Liang-Chieh Chen George Papandreou Iasonas Kokkinos Kevin Murphy Alan Yuille
+	Instance Normalization: The Missing Ingredient for Fast Stylization	2016	Dmitry Ulyanov Andrea Vedaldi Victor Lempitsky
+ PDF Chat	Pyramid Scene Parsing Network	2017	Hengshuang Zhao Jianping Shi Xiaojuan Qi Xiaogang Wang Jiaya Jia