Sparse Communication for Distributed Gradient Descent.
Alham Fikri AjiKenneth HeafieldPublished in: EMNLP (2017)
Keyphrases
- communication overhead
- communication cost
- distributed control
- spatially distributed
- computer networks
- distributed systems
- fully distributed
- cooperative
- high dimensional
- distributed computation
- sparse data
- multi party
- cost function
- mobile agents
- distributed environment
- group communication
- loss function
- distributed network
- information dissemination
- peer to peer
- network nodes
- communication systems
- error function
- communication channels
- neural network
- communication networks
- information sharing
- objective function