Learning Rate Annealing Can Provably Help Generalization, Even for Convex Problems.

Preetum Nakkiran

Published in: CoRR (2020)

Keyphrases

learning rate
convergence rate
rapid convergence
artificial neural networks
multi class
simulated annealing
theoretical guarantees
neural network
genetic algorithm
learning algorithm
optimization problems
convex optimization