HarmonyBatch: Batching multi-SLO DNN Inference with Heterogeneous Serverless Functions.

Jiabin Chen Fei Xu Yikun Gu Li Chen Fangming Liu Zhi Zhou

Published in: CoRR (2024)

Keyphrases

bayesian networks
artificial intelligence
website
heterogeneous data
scheduling problem
probabilistic inference
inference engine
probabilistic reasoning
inference process