• search
    search
  • reviewers
    reviewers
  • feeds
    feeds
  • assignments
    assignments
  • settings
  • logout

FP6-LLM: Efficiently Serving Large Language Models Through FP6-Centric Algorithm-System Co-Design.

Haojun XiaZhen ZhengXiaoxia WuShiyang ChenZhewei YaoStephen YounArash BakhtiariMichael WyattDonglin ZhuangZhongzhu ZhouOlatunji RuwaseYuxiong HeShuaiwen Leon Song
Published in: CoRR (2024)
Keyphrases
  • language model
  • probabilistic model
  • k means
  • language modeling
  • clustering method
  • n gram