Open Problem: Anytime Convergence Rate of Gradient Descent.

Guy Kornowski Ohad Shamir

Published in: CoRR (2024)

Keyphrases

convergence rate
conjugate gradient
convergence speed
learning rate
step size
global convergence
objective function
cost function
mutation operator
numerical stability
primal dual
loss function
gradient method
neural network
variable step size