When Does Second-Order Optimization Speed Up Training?
Satoki IshikawaRio YokotaPublished in: Tiny Papers @ ICLR (2024)
Keyphrases
- optimization algorithm
- supervised learning
- training process
- optimization process
- training set
- global optimization
- optimization problems
- training examples
- training phase
- constrained optimization
- training algorithm
- high order
- test set
- higher order
- objective function
- optimization strategies
- optimal design
- joint optimization
- data mining
- optimization methods
- training samples
- multi objective
- case study
- computer vision