Domain-specific Communication Optimization for Distributed DNN Training.
Hao WangJingrong ChenXinchen WanHan TianJiacheng XiaGaoxiong ZengWeiyan WangKai ChenWei BaiJunchen JiangPublished in: CoRR (2020)
Keyphrases
- domain specific
- training process
- communication overhead
- communication cost
- general purpose
- distributed control
- fully distributed
- cooperative
- domain independent
- distributed systems
- computer networks
- distributed environment
- spatially distributed
- optimization problems
- global optimization
- distributed network
- optimization algorithm
- distributed computation
- multi agent
- open systems
- test set
- training data
- information dissemination
- domain experts
- group communication
- fault tolerant
- optimization method
- training samples
- data sets
- hearing impaired
- single point of failure
- tcp ip
- communication networks
- online learning
- supervised learning
- training set
- social networks