Large Catapults in Momentum Gradient Descent with Warmup: An Empirical Study.

Prin Phunyaphibarn Junghyun Lee Bohan Wang Huishuai Zhang Chulhee Yun

Published in: CoRR (2023)

Keyphrases

cost function
learning rate
error function
objective function
loss function
neural network
update rule
learning rules
search algorithm
wide range
artificial intelligence
real time
multi agent systems
lower bound
support vector
least squares
three dimensional
image processing