Logit Standardization in Knowledge Distillation.

Shangquan Sun Wenqi Ren Jingzhi Li Rui Wang Xiaochun Cao

Published in: CoRR (2024)

Keyphrases

expert systems
domain knowledge
knowledge base
knowledge representation
learning systems
search algorithm
knowledge based systems
knowledge transfer
artificial intelligence
computer vision
information systems
similarity measure
prior knowledge
knowledge acquisition
knowledge sharing
knowledge extraction