Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions.
Kiwon LeeAndrew N. ChengElliot PaquetteCourtney PaquettePublished in: NeurIPS (2022)
Keyphrases
- batch size
- high dimensions
- batch mode
- batch processing
- high dimensional data
- single item
- poisson process
- high dimensional
- fixed cost
- poor quality
- high dimensional spaces
- incremental learning
- lot sizing
- raw material
- lead time
- learning algorithm
- finite horizon
- supervised learning
- nearest neighbor
- high dimensionality
- model selection
- semi supervised
- active learning
- feature extraction