Stochastic Gradient Descent on Modern Hardware: Multi-core CPU or GPU? Synchronous or Asynchronous?

Yujing Ma Florin Rusu Martin Torres

Published in: IPDPS (2019)

Keyphrases

active learning
stochastic gradient descent
graphics processing units
least squares
matrix factorization
loss function
step size
random forests
support vector machine
machine learning
weight vector
importance sampling
online algorithms
regularization parameter
image restoration
multiple kernel learning