On the fast convergence of minibatch heavy ball momentum.

Raghu Bollapragada Tyler Chen Rachel Ward

Published in: CoRR (2022)

Keyphrases

learning rate
convergence rate
convergence theorem
neural network
convergence speed
bayesian networks
database
initial conditions
global convergence
convergence analysis
convergence proof
search engine
special case
data mining
data sets
weight update
rapid convergence
asymptotic convergence
real time