Amortized Nesterov's Momentum: A Robust Momentum and Its Application to Deep Learning.

Kaiwen Zhou Yanghua Jin Qinghua Ding James Cheng

Published in: UAI (2020)

Keyphrases

deep learning
learning rate
machine learning
unsupervised learning
unsupervised feature learning
mental models
semidefinite programming
deep architectures
pattern recognition
active learning
question answering
learning strategies
partial occlusion
automatic extraction