Revisiting Label Smoothing and Knowledge Distillation Compatibility: What was Missing?
Keshigeyan ChandrasegaranNgoc-Trung TranYunqing ZhaoNgai-Man CheungPublished in: CoRR (2022)
Keyphrases
- knowledge extraction
- knowledge base
- domain knowledge
- learning systems
- knowledge sources
- expert systems
- knowledge representation
- knowledge discovery
- background knowledge
- missing information
- databases
- incomplete information
- knowledge based systems
- language model
- knowledge management
- learning environment
- multiscale
- artificial intelligence
- genetic algorithm