Disentangling the Mechanisms Behind Implicit Regularization in SGD.

Zachary Novack Simran Kaur Tanya Marwah Saurabh Garg Zachary C. Lipton

Published in: CoRR (2022)

Keyphrases

stochastic gradient descent
regularization parameter
least squares
online learning
loss function
machine learning
clustering algorithm
random forests
regularization methods
projection operator