On the Convergence of Adaptive Gradient Methods for Nonconvex Optimization.

Dongruo Zhou Yiqi Tang Ziyan Yang Yuan Cao Quanquan Gu

Published in: CoRR (2018)

Keyphrases

significant improvement
optimization problems
global optimization
quasi newton
neural network
reinforcement learning
preprocessing
empirical studies
optimization algorithm
convergence analysis
objective function
machine learning methods
steepest ascent