Divergence of the ADAM algorithm with fixed-stepsize: a (very) simple example.
Philippe L. TointPublished in: CoRR (2023)
Keyphrases
- cost function
- worst case
- optimization algorithm
- dynamic programming
- step size
- optimal solution
- learning algorithm
- convergence rate
- expectation maximization
- k means
- computational complexity
- search space
- artificial neural networks
- simulated annealing
- objective function
- multi objective
- evolutionary algorithm
- linear programming
- image processing
- genetic algorithm