Understanding Adam Optimizer via Online Learning of Updates: Adam is FTRL in Disguise.

Kwangjun Ahn Zhiyu Zhang Yunbum Kook Yan Dai

Published in: CoRR (2024)

Keyphrases

online learning
online course
computer mediated
deeper understanding
higher education
distance education
data structure
query optimization
active learning
e learning
information systems
neural network
databases
database
lower bound
decision trees
learning algorithm
data mining
data sets