Implicit Compressibility of Overparametrized Neural Networks Trained with Heavy-Tailed SGD.

Yijun Wan Abdellatif Zaidi Umut Simsekli

Published in: CoRR (2023)

Keyphrases

heavy tailed
neural network
generalized gaussian
heavy tails
training set
multiresolution
probabilistic model
prior distribution