Polynomial Learning Rate Policy with Warm Restart for Deep Neural Network.
Purnendu MishraKishor SarawadekarPublished in: TENCON (2019)
Keyphrases
- learning rate
- adaptive learning rate
- neural network
- hidden layer
- activation function
- training algorithm
- convergence rate
- fuzzy neural network
- learning algorithm
- error function
- group method of data handling
- feed forward neural networks
- random walk
- feedforward neural networks
- convergence speed
- rapid convergence
- optimal policy
- multilayer neural networks
- weight vector
- recurrent neural networks
- multilayer perceptron
- network architecture
- back propagation
- multi class
- objective function
- genetic algorithm
- machine learning