On the insufficiency of existing momentum schemes for Stochastic Optimization.

Rahul Kidambi Praneeth Netrapalli Prateek Jain Sham M. Kakade

Published in: CoRR (2018)

Keyphrases

stochastic optimization
multistage
learning rate
bayesian networks
objective function
search space
singular value decomposition