Error Lower Bounds of Constant Step-size Stochastic Gradient Descent.

Zhiyan Ding Yiding Chen Qin Li Xiaojin Zhu

Published in: CoRR (2019)

Keyphrases

step size
stochastic gradient descent
lower bound
convergence rate
convergence speed
cost function
online algorithms
upper bound
objective function
np hard
wavelet coefficients
matrix factorization
least squares
monte carlo
cross validation
learning algorithm
online learning
generalization error
decision trees