Stochastic gradient descent introduces an effective landscape-dependent regularization favoring flat solutions.

Ning Yang Chao Tang Yuhai Tu

Published in: CoRR (2022)

Keyphrases

stochastic gradient descent
least squares
loss function
step size
matrix factorization
early stopping
regularization parameter
decision trees
optimal solution
prediction accuracy
closed form
random forests