On the Utility of Gradient Compression in Distributed Training Systems.
Saurabh AgarwalHongyi WangShivaram VenkataramanDimitris S. PapailiopoulosPublished in: CoRR (2021)
Keyphrases
- distributed systems
- complex systems
- intelligent systems
- highly distributed
- mobile agents
- management system
- learning systems
- autonomous mobile
- data sets
- distributed object
- utility function
- computer systems
- lightweight
- test set
- hidden markov models
- artificial neural networks
- retrieval systems
- cooperative
- distributed environment
- computer networks
- fault tolerant
- computing systems
- open systems
- multi agent
- image processing
- neural network