Appropriate Learning Rates of Adaptive Learning Rate Optimization Algorithms for Training Deep Neural Networks.
Hideaki IidukaPublished in: IEEE Trans. Cybern. (2022)
Keyphrases
- adaptive learning rate
- learning rate
- neural network
- convergence rate
- learning algorithm
- globally convergent
- backpropagation algorithm
- optimization problems
- training algorithm
- global convergence
- convergence speed
- evolutionary algorithm
- gaussian kernels
- artificial neural networks
- optimization algorithm
- optimization methods
- genetic algorithm
- multi objective
- global optimization
- training data