XLM-E: Cross-lingual Language Model Pre-training via ELECTRA.
Zewen ChiShaohan HuangLi DongShuming MaBo ZhengSaksham SinghalPayal BajajXia SongXian-Ling MaoHeyan HuangFuru WeiPublished in: ACL (1) (2022)
Keyphrases
- language modeling
- cross lingual
- language model
- translation model
- pseudo feedback
- n gram
- retrieval model
- information retrieval
- probabilistic model
- cross lingual information retrieval
- query expansion
- document retrieval
- language independent
- cross language retrieval
- cross language
- statistical machine translation
- speech recognition
- training set
- test collection
- context sensitive
- vector space model
- query terms
- relevance model
- text classification
- smoothing methods
- machine translation
- pseudo relevance feedback
- information retrieval systems
- semi supervised
- parallel corpora
- query specific
- out of vocabulary
- clustering algorithm
- learning algorithm