A Recipe for Global Convergence Guarantee in Deep Neural Networks.
Kenji KawaguchiQingyun SunPublished in: AAAI (2021)
Keyphrases
- global convergence
- neural network
- global optimum
- convergence rate
- convergence speed
- convergence analysis
- optimization methods
- convex minimization
- pattern recognition
- constrained optimization problems
- fuzzy logic
- particle swarm
- genetic algorithm
- line search
- coordinate ascent
- back propagation
- artificial neural networks
- hybrid algorithm
- globally convergent
- step size
- simulated annealing
- objective function
- multiscale
- feature extraction
- particle swarm optimization
- np hard
- newton method