Towards a phenomenological understanding of neural networks: data
Towards a phenomenological understanding of neural networks: data
Abstract A theory of neural networks (NNs) built upon collective variables would provide scientists with the tools to better understand the learning process at every stage. In this work, we introduce two such variables, the entropy and the trace of the empirical neural tangent kernel (NTK) built on the training …