Prefer a chat interface with context about you and your work?
Instance Enhancement Batch Normalization: An Adaptive Regulator of Batch Noise
Batch Normalization (BN) (Ioffe and Szegedy 2015) normalizes the features of an input image via statistics of a batch of images and hence BN will bring the noise to the gradient of training loss. Previous works indicate that the noise is important for the optimization and generalization of deep neural …