What Makes Quantization for Large Language Model Hard? An Empirical Study from the Lens of Perturbation.
Zhuocheng GongJiahao LiuJingang WangXunliang CaiDongyan ZhaoRui YanPublished in: AAAI (2024)
Keyphrases
- language model
- language modeling
- n gram
- probabilistic model
- retrieval model
- language modelling
- test collection
- information retrieval
- document retrieval
- query expansion
- speech recognition
- context sensitive
- smoothing methods
- ad hoc information retrieval
- translation model
- mixture model
- language models for information retrieval
- statistical language models
- document ranking
- document length
- pseudo relevance feedback
- relevance model
- cross lingual
- word error rate
- statistical machine translation
- language model for information retrieval