A Recipe for Global Convergence Guarantee in Deep Neural Networks.
Kenji KawaguchiQingyun SunPublished in: CoRR (2021)
Keyphrases
- global convergence
- neural network
- global optimum
- convergence speed
- convergence rate
- optimization methods
- convergence analysis
- constrained optimization problems
- convex minimization
- pattern recognition
- genetic algorithm
- fuzzy logic
- line search
- globally convergent
- coordinate ascent
- optimization method
- back propagation
- hybrid algorithm
- training algorithm
- particle swarm
- newton method
- particle swarm optimization
- image compression
- simulated annealing
- evolutionary algorithm
- artificial neural networks
- optimal solution