Early Stage Convergence and Global Convergence of Training Mildly Parameterized Neural Networks.
Mingze WangChao MaPublished in: NeurIPS (2022)
Keyphrases
- global convergence
- early stage
- neural network
- global optimum
- convergence rate
- convergence speed
- convergence analysis
- training process
- optimization methods
- training algorithm
- constrained optimization problems
- coordinate ascent
- convex minimization
- line search
- feedforward neural networks
- multi layer perceptron
- globally convergent
- artificial neural networks
- backpropagation algorithm
- simulated annealing
- optimization method
- back propagation
- fuzzy logic
- hybrid algorithm
- genetic algorithm
- early diagnosis
- particle swarm
- step size
- genetic algorithm ga
- faster convergence
- cost function
- evolutionary algorithm
- search space
- particle swarm optimization algorithm
- optimization problems
- newton method
- neural network training
- particle swarm optimization