Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum.

Zeke Xie Xinrui Wang Huishuai Zhang Issei Sato Masashi Sugiyama

Published in: ICML (2022)

Keyphrases

learning rate
adaptive learning rate
convergence rate
learning algorithm
neural network
convergence speed
feature selection
globally convergent