Login / Signup

MuxServe: Flexible Multiplexing for Efficient Multiple LLM Serving.

Jiangfei DuanRunyu LuHaojie DuanmuXiuhong LiXingcheng ZhangDahua LinIon StoicaHao Zhang
Published in: CoRR (2024)
Keyphrases
  • data sets
  • databases
  • multiscale
  • lightweight
  • case study
  • data structure
  • information technology
  • pairwise
  • special case
  • medical images
  • computationally efficient
  • cost effective
  • highly efficient