On the Convergence of Adam and Adagrad.

Alexandre Défossez Léon Bottou Francis R. Bach Nicolas Usunier

Published in: CoRR (2020)

Keyphrases

convergence speed
initial conditions
convergence rate
rapid convergence
general regression neural networks
knowledge base
case study
high level
image sequences
significant improvement
theoretical justification
convergence proof