DAPPLE: A Pipelined Data Parallel Approach for Training Large Models.
Shiqing FanYi RongChen MengZongyan CaoSiyu WangZhen ZhengChuan WuGuoping LongJun YangLixue XiaLansong DiaoXiaoyong LiuWei LinPublished in: CoRR (2020)
Keyphrases
- data collection
- data sets
- synthetic data
- raw data
- training examples
- experimental data
- sensor data
- data processing
- small number
- empirical data
- historical data
- prior knowledge
- end users
- data structure
- database
- neural network
- machine learning
- learning algorithm
- high quality
- data analysis
- training samples
- artificial neural networks
- data mining techniques
- data sources
- data points
- computer systems
- data distribution
- statistical models
- original data
- incomplete data
- knowledge discovery