Rethinking Soft Labels for Knowledge Distillation: A Bias-Variance Tradeoff Perspective.
Helong ZhouLiangchen SongJiajie ChenYe ZhouGuoli WangJunsong YuanQian ZhangPublished in: CoRR (2021)
Keyphrases
- bias variance tradeoff
- domain knowledge
- knowledge base
- prior knowledge
- knowledge sharing
- knowledge management
- social networks
- knowledge representation
- learning systems
- artificial intelligence
- face recognition
- association rules
- viewpoint
- data sets
- learning algorithm
- case based reasoning
- machine learning
- data mining techniques
- image classification
- data mining
- knowledge extraction
- databases