Login / Signup

LLM-PQ: Serving LLM on Heterogeneous Clusters with Phase-Aware Partition and Adaptive Quantization.

Juntao ZhaoBorui WanYanghua PengHaibin LinChuan Wu
Published in: CoRR (2024)
Keyphrases