A Note on the Global Convergence of Multilayer Neural Networks in the Mean Field Regime.
Huy Tuan PhamPhan-Minh NguyenPublished in: CoRR (2020)
Keyphrases
- global convergence
- multilayer neural networks
- learning rate
- coordinate ascent
- convergence rate
- convergence speed
- global optimum
- convergence analysis
- optimization methods
- constrained optimization problems
- convex minimization
- learning algorithm
- markov random field
- step size
- belief networks
- globally convergent
- em algorithm
- free energy
- line search
- closed form
- genetic algorithm
- particle swarm optimization algorithm
- markov networks
- particle swarm
- newton method
- search algorithm
- least squares
- simulated annealing
- graphical models
- artificial intelligence
- primal dual
- genetic programming