SGD with Clipping is Secretly Estimating the Median Gradient.

Fabian Schaipp Guillaume Garrigos Umut Simsekli Robert M. Gower

Published in: CoRR (2024)

Keyphrases

rigid body
gradient direction
machine learning
accurate estimation
stochastic gradient descent
real time
image processing
reinforcement learning
median filter
estimation process