Communication-efficient Distributed SGD with Sketching.

Nikita Ivkin Daniel Rothchild Enayat Ullah Vladimir Braverman Ion Stoica Raman Arora

Published in: NeurIPS (2019)

Keyphrases

computer networks
communication overhead
distributed computation
spatially distributed
distributed control
lightweight
communication cost
distributed environment
distributed systems
cooperative
multi agent
neural network
load balancing
computationally efficient
multi party
cost function
global knowledge