When, Why and How Much? Adaptive Learning Rate Scheduling by Refinement.

Aaron Defazio Ashok Cutkosky Harsh Mehta Konstantin Mishchenko

Published in: CoRR (2023)

Keyphrases

adaptive learning rate
learning rate
neural network
globally convergent
particle swarm optimization
resource allocation
multiple objectives