Open Problem: Anytime Convergence Rate of Gradient Descent.
Guy KornowskiOhad ShamirPublished in: COLT (2024)
Keyphrases
- convergence rate
- conjugate gradient
- step size
- convergence speed
- learning rate
- global convergence
- gradient method
- objective function
- primal dual
- cost function
- learning algorithm
- numerical stability
- mutation operator
- gravitational search algorithm
- stochastic gradient descent
- loss function
- optimization algorithm
- evolutionary algorithm
- reinforcement learning