Larger-Scale Transformers for Multilingual Masked Language Modeling.
Naman GoyalJingfei DuMyle OttGiri AnantharamanAlexis ConneauPublished in: CoRR (2021)
Keyphrases
- language modeling
- larger scale
- cross lingual
- language model
- comparable corpora
- retrieval model
- language independent
- information retrieval
- query expansion
- n gram
- small scale
- cross language
- probabilistic model
- text classification
- statistical language models
- digital libraries
- pseudo feedback
- word segmentation
- text retrieval
- translation model
- parallel corpus
- sentence retrieval
- query translation
- document retrieval
- natural language processing
- query terms
- test collection
- dimensionality reduction
- search engine
- learning algorithm