Adam Can Converge Without Any Modification On Update Rules.

Yushun Zhang Congliang Chen Naichen Shi Ruoyu Sun Zhi-Quan Luo

Published in: NeurIPS (2022)

Keyphrases

update rules
loss function
particle swarm optimisation
update rule
machine learning
neural network
optimal solution
pairwise