Larger-Scale Transformers for Multilingual Masked Language Modeling.
Naman GoyalJingfei DuMyle OttGiri AnantharamanAlexis ConneauPublished in: RepL4NLP@ACL-IJCNLP (2021)
Keyphrases
- larger scale
- language modeling
- cross lingual
- language model
- comparable corpora
- retrieval model
- information retrieval
- language independent
- query expansion
- cross language
- n gram
- probabilistic model
- small scale
- parallel corpus
- text classification
- translation model
- pseudo feedback
- word segmentation
- parallel corpora
- digital libraries
- statistical language models
- cross language information retrieval
- bayesian networks
- multimedia
- query translation
- metadata
- data mining
- statistical language modeling