Asynchronous Optimization Methods for Efficient Training of Deep Neural Networks with Guarantees.
Vyacheslav KungurtsevMalcolm EganBapi ChatterjeeDan AlistarhPublished in: AAAI (2021)
Keyphrases
- neural learning
- optimization methods
- neural network
- optimization method
- efficient optimization
- optimization problems
- training algorithm
- training process
- global convergence
- stochastic methods
- feedforward neural networks
- optimization approaches
- simulated annealing
- supervised learning
- multi layer perceptron
- multilayer perceptron
- feed forward neural networks
- artificial neural networks
- unconstrained optimization
- quasi newton
- rbf network
- neural network training
- trust region
- portfolio optimization
- feed forward
- back propagation
- genetic algorithm