Stochastic Gradient Descent with Large Learning Rate.

Kangqiao Liu Ziyin Liu Masahito Ueda

Published in: CoRR (2020)

Keyphrases

learning rate
stochastic gradient descent
weight vector
convergence rate
step size
convergence speed
learning algorithm
matrix factorization
training speed
loss function
least squares
perceptron algorithm
random forests
online algorithms
multiple kernel learning
text categorization
support vector
genetic algorithm