PyTorch Distributed: Experiences on Accelerating Data Parallel Training.
Shen LiYanli ZhaoRohan VarmaOmkar SalpekarPieter NoordhuisTeng LiAdam PaszkeJeff SmithBrian VaughanPritam DamaniaSoumith ChintalaPublished in: CoRR (2020)
Keyphrases
- data sets
- data collection
- raw data
- data analysis
- high quality
- training data
- distributed data
- small number
- original data
- data processing
- database
- data distribution
- experimental data
- sensor data
- heterogeneous databases
- data quality
- case study
- spatial data
- synthetic data
- high dimensional data
- training samples
- input data
- prior knowledge
- cooperative
- data structure