Revisit the Power of Vanilla Knowledge Distillation: from Small Scale to Large Scale.
Zhiwei HaoJianyuan GuoKai HanHan HuChang XuYunhe WangPublished in: NeurIPS (2023)
Keyphrases
- small scale
- larger scale
- knowledge base
- domain knowledge
- knowledge acquisition
- maximum power point tracking
- knowledge extraction
- expert systems
- prior knowledge
- knowledge management
- higher level
- power consumption
- database
- knowledge discovery
- data mining techniques
- evolutionary algorithm
- domain experts
- semantic information
- knowledge sources
- expert knowledge
- genetic algorithm
- data mining