Haojie Duanmu

Publication Activity (10 Years)

Years Active: 2024-2024
Publications (10 Years): 3

Top Topics

Language Modelling

Context Sensitive

Ad Hoc Information Retrieval

Top Venues

Publications

Haojie Duanmu, Zhihang Yuan, Xiuhong Li, Jiangfei Duan, Xingcheng Zhang, Dahua Lin
SKVQ: Sliding-window Key and Value Cache Quantization for Large Language Models. CoRR (2024)
Jiangfei Duan, Runyu Lu, Haojie Duanmu, Xiuhong Li, Xingcheng Zhang, Dahua Lin, Ion Stoica, Hao Zhang
MuxServe: Flexible Multiplexing for Efficient Multiple LLM Serving. CoRR (2024)
Yuxuan Yue, Zhihang Yuan, Haojie Duanmu, Sifan Zhou, Jianlong Wu, Liqiang Nie
WKVQuant: Quantizing Weight and Key/Value Cache for Large Language Models Gains More. CoRR (2024)