Login / Signup

Scissorhands: Exploiting the Persistence of Importance Hypothesis for LLM KV Cache Compression at Test Time.

Zichang LiuAditya DesaiFangshuo LiaoWeitao WangVictor XieZhaozhuo XuAnastasios KyrillidisAnshumali Shrivastava
Published in: CoRR (2023)
Keyphrases