Accelerating Multilingual Language Model for Excessively Tokenized Languages.
Jimin HongGibbeum LeeJaewoong ChoPublished in: ACL (Findings) (2024)
Keyphrases
- language model
- language modeling
- cross lingual
- language independent
- n gram
- comparable corpora
- translation model
- retrieval model
- cross lingual information retrieval
- information retrieval
- document retrieval
- query expansion
- cross language
- statistical machine translation
- probabilistic model
- language modelling
- speech recognition
- mixture model
- context sensitive
- machine translation system
- document ranking
- ad hoc information retrieval
- cross language information retrieval
- test collection
- relevance model
- pseudo relevance feedback
- statistical language models
- language models for information retrieval
- indian languages
- language model for information retrieval
- parallel corpora
- retrieval effectiveness
- machine translation
- text classification
- search engine
- linguistic resources
- out of vocabulary
- chinese english
- topic models
- dirichlet prior
- statistical language modeling
- natural language