The Heavy-Tail Phenomenon in SGD.

Mert Gürbüzbalaban Umut Simsekli Lingjiong Zhu

Published in: ICML (2021)

Keyphrases

stochastic gradient descent
real time
collaborative filtering
data sets
neural network
three dimensional
optical flow
least squares
matrix factorization