Meta Distant Transfer Learning for Pre-trained Language Models.
Chengyu WangHaojie PanMinghui QiuJun HuangFei YangYin ZhangPublished in: EMNLP (1) (2021)
Keyphrases
- transfer learning
- language model
- pre trained
- training data
- language modeling
- labeled data
- training examples
- probabilistic model
- knowledge transfer
- active learning
- cross domain
- collaborative filtering
- reinforcement learning
- learning algorithm
- speech recognition
- retrieval model
- semi supervised learning
- information retrieval
- machine learning
- context sensitive
- structure learning
- query expansion
- control signals
- text categorization
- machine learning algorithms
- text mining
- transfer knowledge
- prior knowledge
- cross lingual
- data sets
- text classification
- data analysis