A Convergence Analysis of Gradient Descent for Deep Linear Neural Networks.

Sanjeev Arora Nadav Cohen Noah Golowich Wei Hu

Published in: CoRR (2018)

Keyphrases

convergence analysis
neural network
gauss newton
global convergence
optimality conditions
learning rules
newton method
genetic algorithm
cost function
objective function
artificial neural networks
convergence rate
approximation methods
learning algorithm
search algorithm
optimization algorithm