Aladdin: Joint Placement and Scaling for SLO-Aware LLM Serving.

Chengyi Nie Rodrigo Fonseca Zhenhua Liu

Published in: CoRR (2024)

Keyphrases

real time
neural network
machine learning
case study
genetic algorithm
social networks
multimedia
three dimensional
image sequences
expert systems
joint estimation