Second-Order Properties of Noisy Distributed Gradient Descent
Second-Order Properties of Noisy Distributed Gradient Descent
We study a fixed step-size distributed gradient descent algorithm for solving optimization problems in which the objective is a finite sum of smooth but possibly non-convex functions. Random perturbations of the gradient descent directions are introduced at each step to actively evade saddle points. Under certain regularity conditions, and with …