Global Convergence of Sobolev Training for Overparametrized Neural Networks.
Jorio CocolaPaul HandPublished in: CoRR (2020)
Keyphrases
- global convergence
- neural network
- training process
- training algorithm
- global optimum
- convergence speed
- convergence analysis
- convergence rate
- optimization methods
- constrained optimization problems
- convex minimization
- feedforward neural networks
- multi layer perceptron
- line search
- back propagation
- feed forward neural networks
- coordinate ascent
- neural network training
- training set
- fuzzy logic
- artificial neural networks
- recurrent neural networks
- multilayer perceptron
- neural network model
- supervised learning
- genetic algorithm
- hybrid algorithm
- differential evolution
- optimization algorithm
- training samples
- particle swarm optimization
- simulated annealing
- globally convergent
- objective function