The Importance of Workload Choice in Evaluating LLM Inference Systems.

Konstantinos Papaioannou Thaleia Dimitra Doudali

Published in: EuroMLSys@EuroSys (2024)

Keyphrases

management system
computer systems
decision making
bayesian networks
computer vision
response time
intelligent systems
building blocks
real time
machine learning
artificial intelligence
search algorithm
distributed systems
complex systems