Adaptive Knowledge Distillation Based on Entropy.
Kisoo KwonHwidong NaHoshik LeeNam Soo KimPublished in: ICASSP (2020)
Keyphrases
- knowledge management
- knowledge base
- domain knowledge
- learning systems
- information theoretic
- background knowledge
- knowledge based systems
- information theory
- data sets
- knowledge representation
- prior knowledge
- expert systems
- case study
- knowledge level
- knowledge transfer
- knowledge extraction
- mutual information
- knowledge sharing
- knowledge acquisition
- similarity measure
- information systems
- databases