Learning-Rate-Free Learning by D-Adaptation.

Aaron Defazio Konstantin Mishchenko

Published in: ICML (2023)

Keyphrases

learning rate
learning algorithm
learning process

convergence rate
neural network

genetic algorithm
reinforcement learning

neural nets
delta bar delta