Adapting Pre-trained Language Models to African Languages via Multilingual Adaptive Fine-Tuning.
Jesujoba O. AlabiDavid Ifeoluwa AdelaniMarius MosbachDietrich KlakowPublished in: COLING (2022)
Keyphrases
- language model
- fine tuning
- language modeling
- cross lingual
- pre trained
- language independent
- n gram
- document retrieval
- retrieval model
- information retrieval
- query expansion
- language modelling
- probabilistic model
- cross language
- speech recognition
- statistical language models
- training data
- test collection
- translation model
- smoothing methods
- language models for information retrieval
- document ranking
- query terms
- relevance model
- parallel corpora
- machine translation
- question answering
- control signals
- training examples
- graph cuts
- learning algorithm