Global Convergence of Second-order Dynamics in Two-layer Neural Networks.
Walid KricheneKenneth F. CaluyaAbhishek HalderPublished in: CoRR (2020)
Keyphrases
- global convergence
- neural network
- multi layer
- global optimum
- convergence rate
- convergence analysis
- convergence speed
- optimization methods
- constrained optimization problems
- convex minimization
- single layer
- coordinate ascent
- recurrent networks
- back propagation
- line search
- neural nets
- fuzzy logic
- dynamical systems
- artificial neural networks
- globally convergent
- genetic algorithm
- training algorithm
- activation function
- particle swarm
- training process
- recurrent neural networks
- simulated annealing
- support vector
- objective function
- step size
- feed forward
- gauss newton
- multiscale
- artificial intelligence