Local Quadratic Convergence of Stochastic Gradient Descent with Adaptive Step Size.

Adityanarayanan Radhakrishnan Mikhail Belkin Caroline Uhler

Published in: CoRR (2021)

Keyphrases

step size
stochastic gradient descent
variable step size
convergence rate
convergence speed
cost function
learning rate
least squares
pairwise
loss function
decision trees
image quality