PANLP at MEDIQA 2019: Pre-trained Language Models, Transfer Learning and Knowledge Distillation.
Wei ZhuXiaofeng ZhouKeqiang WangXun LuoXiepeng LiYuan NiGuotong XiePublished in: BioNLP@ACL (2019)
Keyphrases
- language model
- transfer learning
- knowledge transfer
- transfer knowledge
- pre trained
- language modeling
- probabilistic model
- transferring knowledge
- retrieval model
- labeled data
- machine learning
- active learning
- information retrieval
- collaborative filtering
- cross domain
- speech recognition
- query expansion
- context sensitive
- reinforcement learning
- semi supervised learning
- knowledge sharing
- prior knowledge
- cross lingual
- learning algorithm
- neural network
- training data
- similarity measure
- machine learning algorithms
- structure learning