Login / Signup

PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling.

Zefan CaiYichi ZhangBofei GaoYuliang LiuTianyu LiuKeming LuWayne XiongYue DongBaobao ChangJunjie HuWen Xiao
Published in: CoRR (2024)
Keyphrases
  • domain knowledge
  • prior knowledge
  • information extraction
  • end users
  • information sources
  • database systems
  • multiresolution
  • structural information
  • information content