Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance.

Dimitris Oikonomou Nicolas Loizou

Published in: CoRR (2024)

Keyphrases

step size
convergence rate
convergence speed
faster convergence
learning rate
quasi newton
line search
convergence proof
high quality
evolutionary programming
global optimum
particle swarm optimization
mutation operator
global convergence
convergence analysis