Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing.
Yu GuRobert TinnHao ChengMichael LucasNaoto UsuyamaXiaodong LiuTristan NaumannJianfeng GaoHoifung PoonPublished in: ACM Trans. Comput. Heal. (2022)
Keyphrases
- language model
- domain specific
- natural language processing
- information extraction
- text mining
- language modeling
- information retrieval
- n gram
- relation extraction
- probabilistic model
- document retrieval
- speech recognition
- machine learning
- retrieval model
- natural language
- named entity recognition
- ad hoc information retrieval
- test collection
- named entities
- wordnet
- language modelling
- mixture model
- semantic relations
- context sensitive
- word sense disambiguation
- vector space model
- knowledge representation
- question answering
- statistical language models
- machine translation
- query expansion
- cross lingual
- translation model
- document ranking
- text summarization
- pseudo relevance feedback
- information retrieval systems
- text classification
- dirichlet prior