Sparse Communication for Distributed Gradient Descent.
Alham Fikri AjiKenneth HeafieldPublished in: CoRR (2017)
Keyphrases
- communication overhead
- communication cost
- distributed systems
- distributed control
- fully distributed
- cost function
- computer networks
- cooperative
- spatially distributed
- high dimensional
- communication technologies
- fault tolerant
- distributed computation
- distributed network
- learning algorithm
- load balance
- communication protocol
- sparse data
- multi party
- exchange information
- communication channels
- communication systems
- distributed environment
- loss function
- group communication
- global knowledge
- multi robot coordination
- error function
- loosely coupled
- information sharing
- load balancing
- mobile agents
- lightweight
- peer to peer
- multi agent systems
- multi agent