Hessian-based Bounds on Learning Rate for Gradient Descent Algorithms.
Prayag GowgiShayan Srinivasa GaraniPublished in: IJCNN (2020)
Keyphrases
- learning rate
- learning algorithm
- natural gradient
- convergence rate
- rapid convergence
- error function
- cost function
- worst case
- upper and lower bounds
- reinforcement learning
- update rule
- neural network
- upper bound
- adaptive learning rate
- optimization methods
- optimization problems
- evolutionary algorithm
- artificial neural networks
- lower bound
- objective function