Sparsification as a Remedy for Staleness in Distributed Asynchronous SGD.

Rosa Candela Giulio Franzese Maurizio Filippone Pietro Michiardi

Published in: CoRR (2019)

Keyphrases

distributed systems
least squares
image sequences
fault tolerant
distributed constraint satisfaction
multi agent
peer to peer
communication overhead
genetic algorithm
lightweight
kernel methods
distributed environment
computer networks
communication cost