Mixture of Modular Experts: Distilling Knowledge from a Multilingual Teacher into Specialized Modular Language Models.
Mohammed Al-MaamariMehdi Ben AmorMichael GranitzerPublished in: CoRR (2024)
Keyphrases
- language model
- mixture model
- language modeling
- document retrieval
- probabilistic model
- statistical language models
- language modelling
- information retrieval
- cross lingual
- speech recognition
- n gram
- retrieval model
- language models for information retrieval
- knowledge discovery
- digital libraries
- cross language
- language model for information retrieval
- document ranking
- translation model
- vector space model
- test collection
- language independent
- text retrieval
- expert finding
- document collections
- web pages
- feature selection