Autonomous Learning Rate Optimization for Deep Learning.
Xiaomeng DongTao TanMichael PotterYun-Chan TsaiGaurav KumarV. Ratna SaripalliTheodore B. TrafalisPublished in: LION (2022)
Keyphrases
- learning rate
- deep learning
- convergence rate
- learning algorithm
- convergence speed
- unsupervised learning
- global optimization
- hidden layer
- unsupervised feature learning
- adaptive learning rate
- weight vector
- weakly supervised
- machine learning
- optimization algorithm
- global convergence
- rapid convergence
- mental models
- convergence theorem
- neural network
- denoising
- multi objective