The Noise Geometry of Stochastic Gradient Descent: A Quantitative and Analytical Characterization.

Mingze Wang Lei Wu

Published in: CoRR (2023)

Keyphrases

stochastic gradient descent
least squares
matrix factorization
loss function
step size
missing data
random forests
noise level
machine learning algorithms
noise reduction
weight vector
online algorithms
feature extraction
multiresolution
prediction accuracy
arbitrary shape