Intermediate-Task Transfer Learning with Pretrained Language Models: When and Why Does It Work?
Yada PruksachatkunJason PhangHaokun LiuPhu Mon HtutXiaoyi ZhangRichard Yuanzhe PangClara VaniaKatharina KannSamuel R. BowmanPublished in: ACL (2020)
Keyphrases
- language model
- transfer learning
- language modeling
- n gram
- labeled data
- document retrieval
- query expansion
- probabilistic model
- knowledge transfer
- information retrieval
- test collection
- retrieval model
- transfer knowledge
- reinforcement learning
- machine learning
- semi supervised learning
- active learning
- cross domain
- structure learning
- language modelling
- machine learning algorithms
- text classification
- collaborative filtering
- text categorization
- domain adaptation
- statistical language models
- text mining
- learning algorithm
- relevance model
- smoothing methods
- context sensitive
- data sets
- language models for information retrieval
- target domain
- unlabeled data
- knowledge discovery
- data mining