Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study.
Zhiqiang ShenZechun LiuDejia XuZitian ChenKwang-Ting ChengMarios SavvidesPublished in: CoRR (2021)
Keyphrases
- domain knowledge
- knowledge acquisition
- expert systems
- knowledge extraction
- knowledge transfer
- knowledge discovery
- knowledge representation
- knowledge base
- neural network
- decision trees
- multiscale
- prior knowledge
- decision making
- information systems
- knowledge management
- data mining techniques
- databases
- knowledge based systems
- higher level
- background knowledge
- data sets
- real time