Stochastic Gradient Descent with Hyperbolic-Tangent Decay.

Bo Yang Hsueh Wei Li I-Chen Wu

Published in: CoRR (2018)

Keyphrases

stochastic gradient descent
least squares
loss function
step size
matrix factorization
stochastic gradient
random forests
weight vector
support vector machine
regularization parameter
multiple kernel learning
online algorithms
importance sampling
multiscale
convergence rate
image restoration
image processing