Universal Approximation with Deep Narrow Networks

Patrick Kidger, Terry Lyons

Type: Preprint

Publication Date: 2019-05-21

Citations: 14

Locations

arXiv (Cornell University) - View

Similar Works

Action	Title	Year	Authors
+	Universal Approximation with Deep Narrow Networks	2019	Patrick Kidger Terry Lyons
+	The necessity of depth for artificial neural networks to approximate certain classes of smooth and bounded functions without the curse of dimensionality	2023	Lukas Gonon Robin Graeber Arnulf Jentzen
+	Universal approximation with complex-valued deep narrow neural networks	2023	Paul Geuchen Thomas Jahn Hannes Matt
+	Approximating Continuous Functions by ReLU Nets of Minimal Width	2017	Boris Hanin Mark Sellke
+	Deep Network Approximation: Beyond ReLU to Diverse Activation Functions	2023	Zhang Shi-jun Jianfeng Lu Hongkai Zhao
+	The Expressive Power of Neural Networks: A View from the Width	2017	Lu Zhou Hongming Pu Feicheng Wang Zhiqiang Hu Liwei Wang
+	Deep Network Approximation with Discrepancy Being Reciprocal of Width to Power of Depth.	2020	Zuowei Shen Haizhao Yang Zhang Shi-jun
+ PDF Chat	Deep Network Approximation Characterized by Number of Neurons	2020	Zuowei Shen Haizhao Yang Zhang Shi-jun
+	Approximation Power of Deep Neural Networks: an explanatory mathematical survey	2022	Mohammad Motamed
+	The Power of Depth for Feedforward Neural Networks	2015	Ronen Eldan Ohad Shamir
+ PDF Chat	New advances in universal approximation with neural networks of minimal width	2024	Dennis Rochau Hanno Gottschalk Robin Chan
+	Approximating smooth functions by deep neural networks with sigmoid activation function	2020	Sophie Langer
+	Approximating smooth functions by deep neural networks with sigmoid activation function.	2020	Sophie Langer
+	A closer look at the approximation capabilities of neural networks	2020	Kai Fong Ernest Chong
+	A closer look at the approximation capabilities of neural networks	2020	Kai Fong Ernest Chong
+	Expressiveness of Neural Networks Having Width Equal or Below the Input Dimension.	2020	Hans-Peter Beise Steve Cruz
+	Deep Network Approximation: Achieving Arbitrary Accuracy with Fixed Number of Neurons	2021	Zuowei Shen Haizhao Yang Zhang Shi-jun
+ PDF Chat	Deep Network With Approximation Error Being Reciprocal of Width to Power of Square Root of Depth	2021	Zuowei Shen Haizhao Yang Zhang Shi-jun
+	Error bounds for approximations with deep ReLU networks	2016	Dmitry Yarotsky
+	Error bounds for approximations with deep ReLU networks	2016	Dmitry Yarotsky

Works That Cite This (13)

Action	Title	Year	Authors
+	Padé Activation Units: End-to-end Learning of Flexible Activation Functions in Deep Networks	2019	Alejandro Molina Patrick Schramowski Kristian Kersting
+	DeepOPF: A Deep Neural Network Approach for Security-Constrained DC Optimal Power Flow	2019	Xiang Pan Tianyu Zhao Minghua Chen Shengyu Zhang
+ PDF Chat	Approximation rates for neural networks with encodable weights in smoothness spaces	2020	Ingo Gühring Mones Raslan
+	Improve Adversarial Robustness via Weight Penalization on Classification Layer	2020	Cong Xu Dan Li Min Yang
+	The Calabi-Yau Landscape: from Geometry, to Physics, to Machine-Learning	2018	Yang‐Hui He
+	Approximation with Neural Networks in Variable Lebesgue Spaces	2020	Ángela Capel Jesús Ocáriz
+	Arbitrary-Depth Universal Approximation Theorems for Operator Neural Networks	2021	Annan Yu Chloé Becquey Diana Halikias Matthew Esmaili Mallory Alex Townsend
+	Approximation Rates for Neural Networks with Encodable Weights in Smoothness Spaces	2020	Ingo Gühring Mones Raslan
+ PDF Chat	Machine-learning mathematical structures	2022	Yang‐Hui He
+	Deep learning in electron microscopy	2020	Jeffrey M. Ede

Works Cited by This (14)

Action	Title	Year	Authors
+ PDF Chat	Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification	2015	Kaiming He Xiangyu Zhang Shaoqing Ren Jian Sun
+	Empirical Evaluation of Rectified Activations in Convolutional Network	2015	Bing Xu Naiyan Wang Tianqi Chen Mu Li
+ PDF Chat	Universal Approximation Depth and Errors of Narrow Belief Networks with Discrete Units	2014	Guido Montúfar
+	Approximating Continuous Functions by ReLU Nets of Minimal Width	2017	Boris Hanin Mark Sellke
+	Searching for Activation Functions	2017	Prajit Ramachandran Barret Zoph Quoc V. Le
+	Nonlinear Approximation and (Deep) ReLU Networks	2019	Ingrid Daubechies Ronald DeVore Simon Foucart Boris Hanin Guergana Petrova
+	Understanding Deep Neural Networks with Rectified Linear Units	2016	Raman Arora Amitabh Basu Poorya Mianjy Anirbit Mukherjee
+ PDF Chat	Optimal approximation of piecewise smooth functions using deep ReLU neural networks	2018	Philipp Petersen Felix Voigtlaender
+	Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)	2015	Djork-Arné Clevert Thomas Unterthiner Sepp Hochreiter
+	Self-Normalizing Neural Networks	2017	Günter Klambauer Thomas Unterthiner Andreas Mayr Sepp Hochreiter