A closer look at the training dynamics of knowledge distillation.
Roy MilesKrystian MikolajczykPublished in: CoRR (2023)
Keyphrases
- domain knowledge
- knowledge representation
- knowledge acquisition
- knowledge base
- learning systems
- knowledge discovery
- knowledge extraction
- training process
- dynamic model
- knowledge sharing
- knowledge based systems
- recurrent networks
- training phase
- training examples
- text classification
- knowledge management
- prior knowledge
- expert systems