Limitations of Knowledge Distillation for Zero-shot Transfer Learning.
Saleh SoltanHaidar KhanWael HamzaPublished in: SustaiNLP@EMNLP (2021)
Keyphrases
- transfer learning
- knowledge transfer
- transfer knowledge
- transferring knowledge
- learning tasks
- knowledge base
- previously learned
- domain knowledge
- cross domain
- manifold alignment
- knowledge sharing
- labeled data
- machine learning
- knowledge management
- text classification
- text categorization
- unsupervised learning
- multi task learning
- text mining
- active learning
- reinforcement learning
- neural network
- semi supervised learning
- data sets
- e government
- semi supervised
- feature selection
- learning algorithm