Second-order Optimization Method for Large Mini-batch: Training ResNet-50 on ImageNet in 35 Epochs.
Kazuki OsawaYohei TsujiYuichiro UenoAkira NaruseRio YokotaSatoshi MatsuokaPublished in: CoRR (2018)
Keyphrases
- optimization method
- optimization algorithm
- neural network training
- optimization process
- optimization methods
- differential evolution
- evolutionary algorithm
- global optimum
- genetic algorithm
- simulated annealing
- particle swarm
- nelder mead simplex
- optimization procedure
- metaheuristic
- linear svm
- training process
- nonlinear optimization
- hybrid algorithm
- hierarchical structure
- higher order
- batch mode
- quasi newton
- training algorithm
- optimization strategy
- classifier training
- search algorithm
- cost function
- supervised learning
- training samples
- training examples