A Performance Improvement Approach for Second-Order Optimization in Large Mini-batch Training.
Hiroki NaganumaRio YokotaPublished in: CCGRID (2019)
Keyphrases
- optimization algorithm
- optimization problems
- optimization process
- batch mode
- higher order
- test set
- stochastic gradient descent
- supervised learning
- training samples
- training set
- optimization model
- global optimization
- training process
- discrete optimization
- feedforward neural networks
- high order
- optimal design
- training phase
- quality prediction
- optimization methods
- optimization method
- neural network
- online learning
- cost function
- significant improvement
- active learning
- evolutionary algorithm
- multiscale