Analyzing the Mono- and Cross-Lingual Pretraining Dynamics of Multilingual Language Models.
Terra BlevinsHila GonenLuke ZettlemoyerPublished in: EMNLP (2022)
Keyphrases
- cross lingual
- language modeling
- language model
- cross lingual information retrieval
- probabilistic model
- retrieval model
- language independent
- n gram
- information retrieval
- cross language
- query expansion
- document retrieval
- translation model
- test collection
- relevance model
- context sensitive
- parallel corpora
- cross language retrieval
- pseudo feedback
- vector space model
- text classification
- text retrieval
- pseudo relevance feedback
- smoothing methods
- query translation
- query terms
- machine translation
- generative model
- linguistic resources
- comparable corpora
- active learning
- clustering algorithm