NormKD: Normalized Logits for Knowledge Distillation.

Zhihao Chi Tu Zheng Hengjia Li Zheng Yang Boxi Wu Binbin Lin Deng Cai

Published in: CoRR (2023)

Keyphrases

knowledge base
knowledge discovery
artificial intelligence
knowledge transfer
machine learning
prior knowledge
domain knowledge
knowledge management
knowledge based systems
knowledge extraction
data mining
knowledge representation
learning systems
domain experts
conceptual framework