Should You Mask 15% in Masked Language Modeling?
Alexander WettigTianyu GaoZexuan ZhongDanqi ChenPublished in: EACL (2023)
Keyphrases
- language modeling
- language model
- information retrieval
- query expansion
- n gram
- retrieval model
- cross lingual
- probabilistic model
- sentence retrieval
- relevance model
- metadata
- language modeling approaches
- improvements in retrieval effectiveness
- comparable corpora
- text classification
- information retrieval systems
- relevance feedback
- data mining
- multimedia
- active learning
- pseudo feedback
- statistical language models
- statistical language modeling