Evolving Learning Rate Optimizers for Deep Neural Networks.
Pedro CarvalhoNuno LourençoPenousal MachadoPublished in: CoRR (2021)
Keyphrases
- learning rate
- neural network
- activation function
- hidden layer
- backpropagation algorithm
- training algorithm
- convergence rate
- adaptive learning rate
- learning algorithm
- connectionist systems
- error function
- weight update
- rapid convergence
- convergence speed
- artificial neural networks
- multilayer neural networks
- feed forward neural networks
- training speed
- feed forward
- back propagation
- feedforward neural networks
- fuzzy neural network
- fuzzy logic
- genetic algorithm
- weight vector
- delta bar delta
- global convergence
- training process
- neural nets
- neural network model
- support vector