Knowledge Distillation Using Hierarchical Self-Supervision Augmented Distribution.
Chuanguang YangZhulin AnLinhang CaiYongjun XuPublished in: IEEE Trans. Neural Networks Learn. Syst. (2024)
Keyphrases
- domain knowledge
- knowledge base
- knowledge acquisition
- knowledge management
- expert systems
- knowledge representation
- data distribution
- higher level
- hierarchical structure
- prior knowledge
- knowledge sharing
- high level
- knowledge sources
- expert knowledge
- gaussian distribution
- database
- knowledge transfer
- learning systems
- knowledge based systems
- training data
- case study
- decision trees
- artificial intelligence
- information retrieval