What Knowledge Gets Distilled in Knowledge Distillation?
Utkarsh OjhaYuheng LiAnirudh Sundara RajanYingyu LiangYong Jae LeePublished in: NeurIPS (2023)
Keyphrases
- knowledge acquisition
- knowledge base
- knowledge management
- knowledge representation
- knowledge discovery
- expert systems
- knowledge extraction
- domain knowledge
- real time
- learning algorithm
- genetic algorithm
- case study
- feature selection
- information systems
- computer vision
- natural language processing
- neural network
- conceptual framework
- knowledge transfer
- databases