QAQ: Quality Adaptive Quantization for LLM KV Cache.

Shichen Dong Wen Cheng Jiayu Qin Wei Wang

Published in: CoRR (2024)

Keyphrases

adaptive quantization
high quality
low bit rate
higher quality
image compression
transmission line
subband coding
image sequences
quality assessment