Should You Mask 15% in Masked Language Modeling?
Alexander WettigTianyu GaoZexuan ZhongDanqi ChenPublished in: CoRR (2022)
Keyphrases
- language modeling
- language model
- information retrieval
- query expansion
- retrieval model
- probabilistic model
- cross lingual
- n gram
- relevance model
- text classification
- active learning
- improvements in retrieval effectiveness
- data mining
- test collection
- information retrieval systems
- multimedia
- trec collections
- term weighting schemes
- statistical language modeling