SAPipe: Staleness-Aware Pipeline for Data Parallel DNN Training.
Yangrui ChenCong XieMeng MaJuncheng GuYanghua PengHaibin LinChuan WuYibo ZhuPublished in: NeurIPS (2022)
Keyphrases
- data sets
- raw data
- training examples
- databases
- data collection
- training data
- data structure
- data points
- test data
- sensor data
- high quality
- statistical analysis
- small number
- image data
- data processing
- input data
- high dimensional data
- missing data
- data distribution
- artificial neural networks
- original data
- training process