On the Utility of Gradient Compression in Distributed Training Systems.
Saurabh AgarwalHongyi WangShivaram VenkataramanDimitris S. PapailiopoulosPublished in: MLSys (2022)
Keyphrases
- distributed systems
- test set
- learning systems
- image compression
- mission critical
- distributed environment
- training process
- complex systems
- open systems
- building blocks
- distributed computation
- distributed network
- distributed object
- cooperative
- multi agent
- autonomous mobile
- training algorithm
- utility function
- retrieval systems
- training samples
- computer systems
- decision makers
- supervised learning
- management system
- video sequences