The Impact of Learning Rate Decay and Periodical Learning Rate Restart on Artificial Neural Network.
Yimin DingPublished in: AIEE (2021)
Keyphrases
- learning rate
- artificial neural networks
- hidden layer
- activation function
- convergence rate
- learning algorithm
- error function
- multilayer neural networks
- convergence speed
- rapid convergence
- bp algorithm
- adaptive learning rate
- random walk
- weight vector
- natural gradient
- neural network
- machine learning
- convergence theorem