Login / Signup

Mooncake: A KVCache-centric Disaggregated Architecture for LLM Serving.

Ruoyu QinZheming LiWeiran HeMingxing ZhangYongwei WuWeimin ZhengXinran Xu
Published in: CoRR (2024)
Keyphrases
  • management system
  • software architecture
  • real time
  • architectural design
  • decision trees
  • multi layer
  • reference model
  • real world
  • machine learning
  • information systems
  • case study
  • database systems
  • design methodology