An Exponential Learning Rate Schedule for Deep Learning.
Zhiyuan LiSanjeev AroraPublished in: ICLR (2020)
Keyphrases
- learning rate
- deep learning
- unsupervised learning
- learning algorithm
- convergence rate
- adaptive learning rate
- unsupervised feature learning
- hidden layer
- convergence speed
- machine learning
- rapid convergence
- deep architectures
- weakly supervised
- delta bar delta
- mental models
- convergence theorem
- evolutionary algorithm
- training data
- computer vision