From Knowledge Distillation to Self-Knowledge Distillation: A Unified Approach with Normalized Loss and Customized Soft Labels.
Zhendong YangAiling ZengZhe LiTianke ZhangChun YuanYu LiPublished in: ICCV (2023)
Keyphrases
- knowledge base
- domain knowledge
- database
- learning systems
- expert systems
- knowledge representation
- knowledge sharing
- artificial intelligence
- feature selection
- prior knowledge
- knowledge acquisition
- data model
- expert knowledge
- raw data
- knowledge based systems
- data mining techniques
- knowledge management
- multi agent
- learning algorithm
- machine learning
- neural network
- databases