Heavy-Tailed Universality Predicts Trends in Test Accuracies for Very Large Pre-Trained Deep Neural Networks.

Charles H. Martin Michael W. Mahoney

Published in: SDM (2020)

Keyphrases

heavy tailed
pre trained
neural network
training data
generalized gaussian
viewpoint
least squares
semi supervised learning
multiscale
prior knowledge
prior distribution