Efficiently Transferring Pre-trained Language Model RoBERTa Base English to Hindi Using WECHSEL.
Ramesh K. BhukyaAnjali ChaturvediHardik BajajUdgam ShahSumit SinghUma Shanker TiwaryPublished in: O-COCOSDA (2023)
Keyphrases
- language model
- statistical machine translation
- pre trained
- language modeling
- n gram
- cross lingual
- machine translation
- cross language retrieval
- comparable corpora
- document retrieval
- retrieval model
- information retrieval
- probabilistic model
- mixture model
- test collection
- translation model
- training data
- speech recognition
- context sensitive
- query expansion
- target language
- cross language
- smoothing methods
- indian languages
- parallel corpora
- query terms
- control signals
- ad hoc information retrieval
- source language
- multiword
- data sets
- transfer learning
- query translation
- training examples
- information retrieval systems
- high dimensional
- neural network