Teach Less, Learn More: On the Undistillable Classes in Knowledge Distillation.
Yichen ZhuNing LiuZhiyuan XuXin LiuWeibin MengLouis WangZhicai OuJian TangPublished in: NeurIPS (2022)
Keyphrases
- knowledge management
- knowledge acquisition
- knowledge based systems
- knowledge base
- prior knowledge
- knowledge representation
- children learn
- knowledge discovery
- domain knowledge
- data mining
- data model
- information retrieval
- knowledge sharing
- knowledge extraction
- expert systems
- multi agent systems
- neural network
- website
- genetic algorithm
- data mining techniques
- learning systems
- domain experts
- complex domains
- acquired knowledge
- real world