On the SDEs and Scaling Rules for Adaptive Gradient Algorithms.

Sadhika Malladi Kaifeng Lyu Abhishek Panigrahi Sanjeev Arora

Published in: NeurIPS (2022)

Keyphrases

computational complexity
computational cost
orders of magnitude
learning algorithm
knowledge base
data structure
adaptive algorithms
data sets
search algorithm
evolutionary algorithm
worst case
theoretical analysis
background knowledge
computationally expensive
recently developed