Retrieval Augmented Language Model Pre-Training.
Kelvin GuuKenton LeeZora TungPanupong PasupatMing-Wei ChangPublished in: ICML (2020)
Keyphrases
- language model
- retrieval model
- document retrieval
- ad hoc information retrieval
- test collection
- query expansion
- information retrieval
- language modeling
- query terms
- language models for information retrieval
- n gram
- cross language retrieval
- statistical language models
- speech recognition
- relevance model
- document ranking
- document length
- smoothing methods
- probabilistic model
- retrieval effectiveness
- language modelling
- trec test collections
- term dependencies
- jelinek mercer
- vector space model
- web page retrieval
- context sensitive
- average precision
- okapi bm
- query specific
- ir models
- document level
- mixture model
- text retrieval
- pseudo feedback
- translation model
- probabilistic retrieval models
- statistical language modeling
- language model for information retrieval
- relevant documents
- retrieval systems
- information retrieval systems
- trec collections
- original query
- pseudo relevance feedback
- term frequency
- retrieval accuracy
- inter document similarities
- image database
- web search
- relevance feedback