On the Compressibility of Quantized Large Language Models.

Yu Mao Weilan Wang Hongchao Du Nan Guan Chun Jason Xue

Published in: CoRR (2024)

Keyphrases

language model
language modeling
document retrieval
n gram
probabilistic model
language modelling
retrieval model

information retrieval
speech recognition
query expansion
test collection
ad hoc information retrieval
context sensitive
pseudo relevance feedback

query terms
vector space model
passage retrieval
document ranking
smoothing methods
statistical language models
word error rate

language model for information retrieval
document length
term dependencies
error rate
co occurrence
decision trees