Efficient Knowledge Distillation from Model Checkpoints.

Chaofei Wang Qisen Yang Rui Huang Shiji Song Gao Huang

Published in: NeurIPS (2022)

Keyphrases

mathematical model
semantic models
theoretical analysis
simulation model
knowledge base
similarity measure
multiscale
expert systems
probability distribution
knowledge representation
input data
knowledge based systems
computational model
experimental data
conceptual model
reasoning process