Divergence Results and Convergence of a Variance Reduced Version of ADAM.

Ruiqi Wang Diego Klabjan

Published in: CoRR (2022)

Keyphrases

convergence proof
relative entropy
convergence rate
kl divergence
neural network
real time
convergence speed
computer vision
case study
data structure
mutual information
initial conditions
iterative algorithms
faster convergence
data mining
kullback leibler
data sets