QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models.

Jing Liu Ruihao Gong Xiuying Wei Zhiwei Dong Jianfei Cai Bohan Zhuang

Published in: CoRR (2023)

Keyphrases

language model
language modeling
n gram
probabilistic model
retrieval model
speech recognition
test collection
document retrieval
information retrieval
statistical language models
query expansion
smoothing methods
language modelling
vector space model
document ranking