An Efficient Multilingual Language Model Compression through Vocabulary Trimming.
Asahi UshioYi ZhouJosé Camacho-ColladosPublished in: CoRR (2023)
Keyphrases
- language model
- language modeling
- n gram
- out of vocabulary
- document retrieval
- probabilistic model
- speech recognition
- cross lingual
- language modelling
- test collection
- retrieval model
- query expansion
- information retrieval
- smoothing methods
- statistical language models
- language independent
- context sensitive
- cross language
- retrieval effectiveness
- document ranking
- mixture model
- chinese english
- document length
- dependency structure
- query terms
- model selection
- information retrieval systems
- language model for information retrieval