Demystifying Learning Rate Policies for High Accuracy Training of Deep Neural Networks.
Yanzhao WuLing LiuJuhyun BaeKa Ho ChowArun IyengarCalton PuWenqi WeiLei YuQi ZhangPublished in: IEEE BigData (2019)
Keyphrases
- learning rate
- backpropagation algorithm
- training algorithm
- rapid convergence
- high accuracy
- neural network
- multilayer neural networks
- hidden layer
- training speed
- adaptive learning rate
- feed forward neural networks
- activation function
- feedforward neural networks
- training process
- convergence rate
- learning algorithm
- error function
- convergence speed
- back propagation
- multi layer perceptron
- fuzzy neural network
- machine learning
- convergence theorem
- weight vector
- genetic algorithm
- multilayer perceptron
- ant colony optimization
- artificial neural networks
- bp neural network algorithm
- feed forward
- optimal policy
- multi objective
- delta bar delta