PyTorch Distributed: Experiences on Accelerating Data Parallel Training.
Shen LiYanli ZhaoRohan VarmaOmkar SalpekarPieter NoordhuisTeng LiAdam PaszkeJeff SmithBrian VaughanPritam DamaniaSoumith ChintalaPublished in: Proc. VLDB Endow. (2020)
Keyphrases
- data collection
- data sets
- database
- data processing
- high dimensional data
- statistical analysis
- data transfer
- distributed data
- data structure
- data analysis
- original data
- prior knowledge
- data sources
- experimental data
- knowledge discovery
- image data
- data distribution
- missing data
- labelled data
- text classification
- data mining techniques
- distributed systems
- data points
- multi agent
- input data
- artificial neural networks
- training set
- high quality
- database systems