On the Stability and Convergence of Stochastic Gradient Descent with Momentum.
Ali Ramezani-KebryaAshish KhistiBen LiangPublished in: CoRR (2018)
Keyphrases
- stochastic gradient descent
- step size
- least squares
- convergence rate
- loss function
- matrix factorization
- learning rate
- convergence speed
- random forests
- weight vector
- support vector machine
- multiple kernel learning
- regularization parameter
- importance sampling
- online algorithms
- monte carlo
- differential evolution
- optical flow
- image sequences
- pairwise
- support vector
- linear svm
- feature extraction