Exploiting Redundancy in Pre-trained Language Models for Efficient Transfer Learning.
Fahim DalviHassan SajjadNadir DurraniYonatan BelinkovPublished in: CoRR (2020)
Keyphrases
- language model
- transfer learning
- language modeling
- pre trained
- probabilistic model
- knowledge transfer
- active learning
- retrieval model
- speech recognition
- labeled data
- cross domain
- text classification
- information retrieval
- collaborative filtering
- reinforcement learning
- context sensitive
- smoothing methods
- query expansion
- machine learning
- semi supervised learning
- decision trees
- computer vision
- structure learning