ReLU Deep Neural Networks and Linear Finite Elements
ReLU Deep Neural Networks and Linear Finite Elements
In this paper, we investigate the relationship between deep neural networks (DNN) with rectified linear unit (ReLU) function as the activation function and continuous piecewise linear (CPWL) functions, especially CPWL functions from the simplicial linear finite element method (FEM).We first consider the special case of FEM.By exploring the DNN representation …