AutoLRS: Automatic Learning-Rate Schedule by Bayesian Optimization on the Fly.
Yuchen JinTianyi ZhouLiangyu ZhaoYibo ZhuChuanxiong GuoMarco CaniniArvind KrishnamurthyPublished in: ICLR (2021)
Keyphrases
- learning rate
- convergence rate
- learning algorithm
- multilayer neural networks
- error function
- rapid convergence
- adaptive learning rate
- optimization algorithm
- hidden layer
- global optimization
- convergence speed
- optimization method
- optimization problems
- global convergence
- scheduling problem
- training algorithm
- weight vector
- delta bar delta
- bp neural network algorithm
- data mining
- activation function
- high accuracy
- genetic algorithm