Practical Insights into Knowledge Distillation for Pre-Trained Models.

Norah Alballa Marco Canini

Published in: CoRR (2024)

Keyphrases

prior knowledge
pre trained
small number
statistical model
data sets
neural network
probabilistic model
data mining
computer vision
feature selection
control signals