AdaLomo: Low-memory Optimization with Adaptive Learning Rate.

Kai Lv Hang Yan Qipeng Guo Haijun Lv Xipeng Qiu

Published in: CoRR (2023)

Keyphrases

low memory
adaptive learning rate
globally convergent
learning rate
optimization problems
neural network
global optimization
memory requirements
learning algorithm
image processing
optimization algorithm
constrained optimization
image sequences
image restoration
optimization method
optimization methods