Eliminating Sharp Minima from SGD with Truncated Heavy-tailed Noise.

Xingyu Wang Sewoong Oh Chang-Han Rhee

Published in: CoRR (2021)

Keyphrases

heavy tailed
generalized gaussian
noise level
heavy tails
noisy data
noise reduction
missing data
signal to noise ratio
gaussian noise
image processing
least squares
generative model
prior information