Knowledge Distillation: Bad Models Can Be Good Role Models.

Gal Kaplun Eran Malach Preetum Nakkiran Shai Shalev-Shwartz

Published in: NeurIPS (2022)

Keyphrases

prior knowledge
three dimensional
probabilistic model
domain knowledge
experimental data
database
databases
real world
knowledge base
website
knowledge representation
knowledge based systems
statistical models