ExeGPT: Constraint-Aware Resource Scheduling for LLM Inference.

Hyungjun Oh Kihong Kim Jaemin Kim Sungkyun Kim Junyeol Lee Du-seong Chang Jiwon Seo

Published in: CoRR (2024)

Keyphrases

resource scheduling
load balancing
grid systems
quality management
business processes