Win: Weight-Decay-Integrated Nesterov Acceleration for Adaptive Gradient Algorithms.

Pan Zhou Xingyu Xie Shuicheng Yan

Published in: ICLR (2023)

Keyphrases

computationally efficient
optimization problems
learning algorithm
orders of magnitude
evolutionary algorithm
significant improvement
computational cost
neural network
genetic algorithm
lower bound
benchmark datasets
recently developed