Multilingual Brain Surgeon: Large Language Models Can be Compressed Leaving No Language Behind.
Hongchuan ZengHongshen XuLu ChenKai YuPublished in: CoRR (2024)
Keyphrases
- language model
- language modeling
- comparable corpora
- n gram
- probabilistic model
- retrieval model
- speech recognition
- document retrieval
- language modelling
- cross lingual
- query expansion
- information retrieval
- context sensitive
- statistical language models
- test collection
- smoothing methods
- relevance model
- parallel corpus
- query terms
- digital libraries
- vector space model
- pseudo relevance feedback
- language models for information retrieval
- machine translation system
- document ranking
- language model for information retrieval
- natural language
- translation model
- language independent
- retrieval effectiveness
- cross language retrieval
- document length
- language modeling framework
- ad hoc information retrieval
- bayesian networks
- feature selection