Momentum Improves Normalized SGD.

Ashok Cutkosky Harsh Mehta

Published in: ICML (2020)

Keyphrases

learning rate
similarity measure
pairwise
genetic algorithm
decision making
image sequences
multiscale
evolutionary algorithm
online learning
linear combination
stochastic gradient descent