On Tight Convergence Rates of Without-replacement SGD.

Kwangjun Ahn Suvrit Sra

Published in: CoRR (2020)

Keyphrases

convergence rate
step size
stochastic gradient descent
convergence speed
learning rate
lower bound
upper bound
global convergence
worst case
mutation operator
stopping criterion
primal dual
conjugate gradient
global optimum