AutoLRS: Automatic Learning-Rate Schedule by Bayesian Optimization on the Fly.
Yuchen JinTianyi ZhouLiangyu ZhaoYibo ZhuChuanxiong GuoMarco CaniniArvind KrishnamurthyPublished in: CoRR (2021)
Keyphrases
- learning rate
- convergence rate
- learning algorithm
- error function
- hidden layer
- rapid convergence
- activation function
- convergence speed
- scheduling problem
- adaptive learning rate
- optimization algorithm
- multilayer neural networks
- global optimization
- global convergence
- optimization method
- particle swarm
- training algorithm
- convergence theorem
- pairwise