A Simple Dynamic Learning Rate Tuning Algorithm For Automated Training of DNNs.
Koyel MukherjeeAlind KhareAshish VermaPublished in: CoRR (2019)
Keyphrases
- learning rate
- adaptive learning rate
- learning algorithm
- convergence rate
- training algorithm
- rapid convergence
- optimization algorithm
- search space
- high accuracy
- training speed
- error function
- multilayer neural networks
- np hard
- cost function
- hidden layer
- convergence speed
- convex hull
- levenberg marquardt
- simulated annealing
- natural gradient
- convergence theorem
- objective function