Convergence and Dynamical Behavior of the ADAM Algorithm for Nonconvex Stochastic Optimization.

Anas Barakat Pascal Bianchi

Published in: SIAM J. Optim. (2021)

Keyphrases

stochastic optimization
particle swarm optimization
convergence rate
learning algorithm
objective function
optimal solution
np hard
dynamic programming
probabilistic model
linear programming
multistage
dynamical behavior