VanillaKD: Revisit the Power of Vanilla Knowledge Distillation from Small Scale to Large Scale.
Zhiwei HaoJianyuan GuoKai HanHan HuChang XuYunhe WangPublished in: CoRR (2023)
Keyphrases
- small scale
- domain knowledge
- larger scale
- knowledge based systems
- knowledge extraction
- maximum power point tracking
- knowledge management
- primary school
- knowledge base
- knowledge sources
- expert systems
- learning systems
- databases
- case based reasoning
- power consumption
- knowledge acquisition
- knowledge discovery
- knowledge representation
- multi agent
- image sequences
- case study
- e learning
- social networks
- machine learning