SCL-IKD: intermediate knowledge distillation via supervised contrastive representation learning.
Saurabh SharmaShikhar Singh LodhiJoydeep ChandraPublished in: Appl. Intell. (2023)
Keyphrases
- learning algorithm
- learning systems
- knowledge acquisition
- supervised learning
- learning process
- prior knowledge
- unsupervised learning
- domain knowledge
- reinforcement learning
- weakly supervised
- learning problems
- knowledge transfer
- learned knowledge
- learning tasks
- formal representation
- multiple representations
- organizational learning
- learning scenarios
- knowledge based systems
- active learning
- knowledge base
- human experts
- neural network
- knowledge level
- learning mechanism
- data mining techniques
- representing knowledge
- intermediate representations