Global Momentum Compression for Sparse Communication in Distributed SGD.
Shen-Yi ZhaoYin-Peng XieHao GaoWu-Jun LiPublished in: CoRR (2019)
Keyphrases
- fully distributed
- communication overhead
- global knowledge
- communication cost
- central site
- globally distributed
- distributed control
- remote sites
- computer networks
- spatially distributed
- distributed systems
- communication technologies
- cooperative
- distributed computation
- global information
- multi agent
- high dimensional
- distributed network
- distributed environment
- multi agent systems
- open systems
- fault tolerant
- exchange information
- sensor networks
- group communication
- sparse representation
- mobile agents
- multi robot coordination
- distributed teams
- support vector
- lightweight
- data compression
- multimedia communication
- information dissemination
- sparse data
- compression algorithm
- learning rate
- compression ratio