Grad-GradaGrad? A Non-Monotone Adaptive Stochastic Gradient Method.

Aaron Defazio Baoyu Zhou Lin Xiao

Published in: CoRR (2022)

Keyphrases

gradient method
convergence rate
step size
recursive least squares
optimization methods
actor critic
negative matrix factorization
computer vision
search space
multiscale
nearest neighbor