Stochastic gradient descent, weighted sampling, and the randomized Kaczmarz algorithm.

Deanna Needell Nathan Srebro Rachel Ward

Published in: Math. Program. (2016)

Keyphrases

stochastic gradient descent
monte carlo
expectation maximization
cost function
optimization algorithm
optimal solution
search space
probabilistic model
learning algorithm
computational complexity
np hard
convergence rate
step size