Optimal Rates for Averaged Stochastic Gradient Descent under Neural Tangent Kernel Regime.

Atsushi Nitanda Taiji Suzuki

Published in: ICLR (2021)

Keyphrases

stochastic gradient descent
early stopping
multiple kernel learning
least squares
matrix factorization
stochastic gradient
kernel methods
lower bound
state space
worst case
image restoration