The Impact of the Mini-batch Size on the Variance of Gradients in Stochastic Gradient Descent.

Xin Qian Diego Klabjan

Published in: CoRR (2020)

Keyphrases

stochastic gradient descent
batch size
least squares
batch mode
step size
loss function
matrix factorization
online algorithms
poisson process
regularization parameter
batch processing
monte carlo
weight vector
active learning
online learning
machine learning
support vector machine
state space
feature selection