Finite-Time Lyapunov Exponents of Deep Neural Networks
Finite-Time Lyapunov Exponents of Deep Neural Networks
We compute how small input perturbations affect the output of deep neural networks, exploring an analogy between deep networks and dynamical systems, where the growth or decay of local perturbations is characterised by finite-time Lyapunov exponents. We show that the maximal exponent forms geometrical structures in input space, akin to …