Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs.

Suyu Ge Yunan Zhang Liyuan Liu Minjia Zhang Jiawei Han Jianfeng Gao

Published in: CoRR (2023)

Keyphrases

probabilistic model
computational model
mathematical model
theoretical framework
process model
data sets
knowledge base
high level
objective function
prior knowledge
management system
parameter estimation
web documents
formal model