Don't Use Large Mini-batches, Use Local SGD.

Tao Lin Sebastian U. Stich Kumar Kshitij Patel Martin Jaggi

Published in: ICLR (2020)

Keyphrases

stochastic gradient descent
multi class
matrix factorization
step size
equal sized
computational complexity
evolutionary algorithm
active learning
loss function