Learned Best-Effort LLM Serving.

Siddharth Jha Coleman Hooper Xiaoxuan Liu Sehoon Kim Kurt Keutzer

Published in: CoRR (2024)

Keyphrases

quality of service
learning process
artificial neural networks
real time
social networks
image processing
decision trees
wide range
user interface