Learning-Rate-Free Learning by D-Adaptation.

Aaron Defazio Konstantin Mishchenko

Published in: ICML (2023)

Keyphrases

learning rate
learning algorithm
learning process
convergence rate
neural network
genetic algorithm
reinforcement learning
neural nets
delta bar delta