Don't Stop Pretraining: Adapt Language Models to Domains and Tasks.
Suchin GururanganAna MarasovicSwabha SwayamdiptaKyle LoIz BeltagyDoug DowneyNoah A. SmithPublished in: ACL (2020)
Keyphrases
- language model
- language modeling
- probabilistic model
- n gram
- retrieval model
- speech recognition
- document retrieval
- language modelling
- information retrieval
- query expansion
- vector space model
- query terms
- smoothing methods
- context sensitive
- transfer learning
- test collection
- word error rate
- okapi bm
- language models for information retrieval
- translation model
- relevance model
- document length
- pseudo relevance feedback
- text classification
- image retrieval