Knowledge Distillation Transfer Sets and their Impact on Downstream NLU Tasks.
Charith PerisLizhen TanThomas GueudréTuran GojayevPan WeiGokmen OzPublished in: EMNLP (Industry Track) (2022)
Keyphrases
- knowledge transfer
- transferring knowledge
- domain knowledge
- previously learned
- transfer learning
- human experts
- knowledge acquisition
- knowledge based systems
- learning systems
- domain experts
- transfer knowledge
- knowledge management
- knowledge discovery
- knowledge representation
- artificial intelligence
- data mining
- knowledge sources
- multi task
- knowledge extraction
- complex domains
- knowledge base
- cognitive effort
- learning algorithm