Deep Gradient Compression: Reducing the Communication Bandwidth for Distributed Training.
Yujun LinSong HanHuizi MaoYu WangWilliam J. DallyPublished in: CoRR (2017)
Keyphrases
- communication bandwidth
- sensor networks
- distributed systems
- compression scheme
- multi agent
- training examples
- cooperative
- distributed environment
- peer to peer
- image compression
- training process
- communication cost
- compression ratio
- image processing
- training phase
- test set
- lightweight
- training set
- data sets
- computer networks
- training samples
- data compression
- online learning
- image quality
- training algorithm
- gradient method
- weighted sums