Knowledge Distillation: Bad Models Can Be Good Role Models.

Gal Kaplun Eran Malach Preetum Nakkiran Shai Shalev-Shwartz

Published in: CoRR (2022)

Keyphrases

statistical models
experimental data
domain knowledge
parameter estimation
complex systems
data sets
real world
website
evolutionary algorithm
prior knowledge
probabilistic model
least squares
knowledge acquisition
knowledge sources
modeling framework