On the Variance of the Adaptive Learning Rate and Beyond.

Liyuan Liu Haoming Jiang Pengcheng He Weizhu Chen Xiaodong Liu Jianfeng Gao Jiawei Han

Published in: CoRR (2019)

Keyphrases

adaptive learning rate
learning rate
neural network
globally convergent
objective function
learning algorithm
computer vision
cost function
denoising
convergence rate