Domain-Specific Language Model Pretraining for Biomedical Natural Language Processing.
Yu GuRobert TinnHao ChengMichael LucasNaoto UsuyamaXiaodong LiuTristan NaumannJianfeng GaoHoifung PoonPublished in: CoRR (2020)
Keyphrases
- language model
- domain specific
- natural language processing
- information extraction
- text mining
- language modeling
- information retrieval
- n gram
- probabilistic model
- language modelling
- machine learning
- document retrieval
- natural language
- speech recognition
- relation extraction
- retrieval model
- context sensitive
- question answering
- mixture model
- named entity recognition
- wordnet
- vector space model
- statistical language models
- query expansion
- test collection
- word sense disambiguation
- part of speech
- named entities
- semantic relations
- query terms
- text classification
- ad hoc information retrieval
- text documents
- knowledge representation
- smoothing methods
- document ranking
- machine translation
- query specific
- pseudo relevance feedback
- text summarization
- retrieval effectiveness
- statistical models
- translation model
- document length
- keywords
- word clouds