Automated Learning Rate Scheduler for Large-batch Training.
Chiheon KimSaehoon KimJongmin KimDonghoon LeeSungwoong KimPublished in: CoRR (2021)
Keyphrases
- learning rate
- multilayer neural networks
- training algorithm
- training speed
- adaptive learning rate
- convergence rate
- learning algorithm
- hidden layer
- feed forward neural networks
- convergence speed
- batch mode
- error function
- rapid convergence
- feedforward neural networks
- convergence theorem
- weight vector
- data mining
- scheduling algorithm
- genetic algorithm