Overlap Local-SGD: An Algorithmic Approach to Hide Communication Delays in Distributed SGD.

Jianyu Wang Hao Liang Gauri Joshi

Published in: CoRR (2020)

Keyphrases

communication delays
stochastic gradient descent
distributed systems
control theory
least squares
directed networks
execution times
sufficient conditions
multiprocessor systems