Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks.
Charith PerisLizhen TanThomas GueudreTuran GojayevPan WeiGokmen OzPublished in: CoRR (2022)
Keyphrases
- knowledge transfer
- domain knowledge
- transfer learning
- transferring knowledge
- previously learned
- knowledge base
- cognitive effort
- knowledge management
- knowledge acquisition
- higher level
- real world
- data mining techniques
- knowledge discovery
- text classification
- design process
- background knowledge
- knowledge sharing
- conceptual model
- knowledge sources
- knowledge representation
- complex domains
- prior knowledge
- knowledge acquired
- training data
- artificial intelligence