Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions.
Kiwon LeeAndrew N. ChengCourtney PaquetteElliot PaquettePublished in: CoRR (2022)
Keyphrases
- batch size
- high dimensions
- batch mode
- batch processing
- single item
- high dimensional data
- poisson process
- high dimensional
- poor quality
- high dimensional spaces
- finite horizon
- incremental learning
- raw material
- data sets
- semi supervised
- active learning
- lead time
- lot sizing
- fixed cost
- standard deviation
- optimal policy
- online algorithms
- nearest neighbor
- data points
- order quantity
- neural network