High Probability Bounds for a Class of Nonconvex Algorithms with AdaGrad Stepsize.

Ali Kavis Kfir Yehuda Levy Volkan Cevher

Published in: ICLR (2022)

Keyphrases

step size
worst case
convergence rate
optimization problems
global optimization
learning algorithm
upper bound
particle swarm optimization
approximation algorithms
lower and upper bounds
convex functions
quasi newton