Scheduled Restart Momentum for Accelerated Stochastic Gradient Descent.
Bao WangTan M. NguyenAndrea L. BertozziRichard G. BaraniukStanley J. OsherPublished in: CoRR (2020)
Keyphrases
- stochastic gradient descent
- learning rate
- least squares
- loss function
- weight vector
- step size
- matrix factorization
- random forests
- support vector machine
- importance sampling
- convergence rate
- multiple kernel learning
- convergence speed
- online algorithms
- closed form
- regularization parameter
- machine learning
- cost function
- decision trees