Login / Signup
The Power of Adaptivity in SGD: Self-Tuning Step Sizes with Unbounded Gradients and Affine Variance.
Matthew Faw
Isidoros Tziotis
Constantine Caramanis
Aryan Mokhtari
Sanjay Shakkottai
Rachel Ward
Published in:
COLT (2022)
Keyphrases
</>
step size
stochastic gradient descent
convergence rate
cost function
convergence speed
evolutionary programming
faster convergence
multiresolution
wavelet transform
digital images
particle swarm optimization
wavelet coefficients