Stochastic Gradient Descent with Polyak's Learning Rate.
Mariana PrazeresAdam M. ObermanPublished in: J. Sci. Comput. (2021)
Keyphrases
- learning rate
- stochastic gradient descent
- weight vector
- convergence rate
- step size
- learning algorithm
- convergence speed
- least squares
- training speed
- matrix factorization
- loss function
- random forests
- online algorithms
- training algorithm
- regularization parameter
- neural network
- particle swarm optimization
- collaborative filtering
- multiple kernel learning
- decision trees
- data mining