Adai: Separating the Effects of Adaptive Learning Rate and Momentum Inertia.

Zeke Xie Xinrui Wang Huishuai Zhang Issei Sato Masashi Sugiyama

Published in: CoRR (2020)

Keyphrases

adaptive learning rate
learning rate
learning algorithm
convergence rate
neural network
particle swarm optimization
game theory