What Knowledge Gets Distilled in Knowledge Distillation?

Utkarsh Ojha Yuheng Li Anirudh Sundara Rajan Yingyu Liang Yong Jae Lee

Published in: NeurIPS (2023)

Keyphrases

knowledge acquisition
knowledge base
knowledge management
knowledge representation
knowledge discovery

expert systems
knowledge extraction
domain knowledge
real time
learning algorithm

genetic algorithm
case study
feature selection
information systems
computer vision

natural language processing
neural network
conceptual framework
knowledge transfer
databases