AdaPlus: Integrating Nesterov Momentum and Precise Stepsize Adjustment on Adamw Basis.

Published in: ICASSP (2024)

Keyphrases

step size
convergence rate
approximate dynamic programming
learning rate
temporal difference
cost function
convergence speed
neural network
multiscale
feature vectors
linear program
semidefinite programming
quasi newton