AdaSGD: Bridging the gap between SGD and Adam.

Jiaxuan Wang Jenna Wiens

Published in: CoRR (2020)

Keyphrases

stochastic gradient descent
least squares
loss function
artificial neural networks
matrix factorization
information retrieval
learning algorithm
computer vision
upper bound
random forests
importance sampling