Stochastic Training of Residual Networks: a Differential Equation Viewpoint

Qi Sun, Yunzhe Tao, Qiang Du

Type: Preprint

Publication Date: 2018-01-01

Citations: 7

DOI: https://doi.org/10.48550/arxiv.1812.00174

View Publication

Locations

arXiv (Cornell University) - View
DataCite API - View

Similar Works

Action	Title	Year	Authors
+	Stochastic Training of Residual Networks: a Differential Equation Viewpoint.	2018	Qi Sun Yunzhe Tao Qiang Du
+	Stochastic Modified Equations and Dynamics of Dropout Algorithm	2023	Zhongwang Zhang Yuqing Li T. Luo Zhi‐Qin John Xu
+	Stochasticity in Neural ODEs: An Empirical Study	2020	V. V. Oganesyan Alexandra Volokhova Dmitry Vetrov
+	Stochasticity in Neural ODEs: An Empirical Study	2020	V. V. Oganesyan Alexandra Volokhova Dmitry Vetrov
+	Stochasticity in Neural ODEs: An Empirical Study	2020	V. V. Oganesyan Alexandra Volokhova Dmitry Vetrov
+	Neural SDE: Stabilizing Neural ODE Networks with Stochastic Noise	2019	Xuanqing Liu Tesi Xiao Si Si Cao Qin Sanjiv Kumar Cho‐Jui Hsieh
+	Mathematical Introduction to Deep Learning: Methods, Implementations, and Theory	2023	Arnulf Jentzen Benno Kuckuck Philippe von Wurstemberger
+	Recent advances in deep learning theory	2020	Fengxiang He Dacheng Tao
+	Stochastic Gradient Langevin Dynamics Based on Quantization with Increasing Resolution	2023	Jinwuk Seok Chang-Sik Cho
+	A stochastic optimization approach to train non-linear neural networks with a higher-order variation regularization	2023	Akifumi Okuno
+	Neural Stochastic Differential Equations.	2019	Stefano Peluchetti Stefano Favaro
+	Revisiting the Noise Model of Stochastic Gradient Descent	2023	Barak Battash Ofir Lindenbaum
+	Stochastic Langevin Differential Inclusions with Applications to Machine Learning	2022	Fabio V. Difonzo Vyacheslav Kungurtsev Jakub Mareček
+	Deep Learning Method for Solving Stochastic Ordinary Differential Equations	2022	保龙孙
+	Implicit regularization of deep residual networks towards neural ODEs	2023	Pierre Marion Yuhan Wu Michael E. Sander Gérard Biau
+	Noisy Recurrent Neural Networks	2021	Soon Hoe Lim N. Benjamin Erichson Liam Hodgkinson Michael W. Mahoney
+	Noisy Recurrent Neural Networks	2021	Soon Hoe Lim N. Benjamin Erichson Liam Hodgkinson Michael W. Mahoney
+	Noisy Recurrent Neural Networks	2021	Soon Hoe Lim N. Benjamin Erichson Liam Hodgkinson Michael W. Mahoney
+ PDF Chat	Physics-Informed Neural Networks: Minimizing Residual Loss with Wide Networks and Effective Activations	2024	Nima Hosseini Dashtbayaz Ghazal Farhani Boyu Wang Charles X. Ling
+	slimTrain -- A Stochastic Approximation Method for Training Separable Deep Neural Networks	2021	Elizabeth Newman Julianne Chung Matthias Chung Lars Ruthotto

Works That Cite This (4)

Action	Title	Year	Authors
+ PDF Chat	A Review on Deep Learning in Medical Image Reconstruction	2020	Haimiao Zhang Bin Dong
+ PDF Chat	PDE+: Enhancing Generalization via PDE with Adaptive Distributional Diffusion	2024	Yige Yuan Bingbing Xu Bo Lin Liang Hou Fei Sun Huawei Shen Xueqi Cheng
+ PDF Chat	Neural Network Layer Algebra: A Framework to Measure Capacity and Compression in Deep Learning	2023	Alberto Badías Ashis G. Banerjee
+ PDF Chat	A cooperative game for automated learning of elasto-plasticity knowledge graphs and models with AI-guided experimentation	2019	Kun Wang WaiChing Sun Qiang Du

Works Cited by This (0)

Action	Title	Year	Authors