Intermediate-Task Transfer Learning with Pretrained Models for Natural Language Understanding: When and Why Does It Work?
Yada PruksachatkunJason PhangHaokun LiuPhu Mon HtutXiaoyi ZhangRichard Yuanzhe PangClara VaniaKatharina KannSamuel R. BowmanPublished in: CoRR (2020)
Keyphrases
- transfer learning
- natural language understanding
- knowledge transfer
- probabilistic model
- learning tasks
- reinforcement learning
- labeled data
- neural network
- natural language
- natural language processing
- transfer knowledge
- multi task
- semi supervised learning
- collaborative filtering
- text mining
- text classification
- low level
- bayesian networks
- machine learning algorithms
- knowledge base
- artificial intelligence
- learning algorithm
- machine learning
- data mining
- language understanding
- databases