SlowMo: Improving Communication-Efficient Distributed SGD with Slow Momentum.
Jianyu WangVinayak TantiaNicolas BallasMichael G. RabbatPublished in: CoRR (2019)
Keyphrases
- communication overhead
- cooperative
- communication cost
- computer networks
- distributed control
- lightweight
- multi agent
- information sharing
- fully distributed
- computationally efficient
- distributed databases
- neural network
- distributed systems
- learning rate
- communication systems
- open systems
- multimedia communication
- distributed computation
- feature selection