On the Global Convergence of Training Deep Linear ResNets.
Difan ZouPhilip M. LongQuanquan GuPublished in: CoRR (2020)
Keyphrases
- global convergence
- global optimum
- convergence analysis
- convergence speed
- convergence rate
- optimization methods
- constrained optimization problems
- convex minimization
- training algorithm
- line search
- deep architectures
- coordinate ascent
- neural network
- machine learning
- training set
- search algorithm
- newton method
- linear model
- variational inequalities
- optimization algorithm
- linear svm
- artificial neural networks