Aligning in a Compact Space: Contrastive Knowledge Distillation between Heterogeneous Architectures.

Hongjun Wu Li Xiao Xingkuo Zhang Yining Miao

Published in: CoRR (2024)

Keyphrases

domain knowledge
knowledge acquisition
knowledge base
knowledge representation
expert systems
databases
knowledge discovery
knowledge management
low dimensional
neural network
image processing
search space
vector space
heterogeneous environments