Sponge: Inference Serving with Dynamic SLOs Using In-Place Vertical Scaling.

Kamran Razavi Saeid Ghafouri Max Mühlhäuser Pooyan Jamshidi Lin Wang

Published in: CoRR (2024)

Keyphrases

dynamic environments
neural network
dynamically changing
bayesian networks
bayesian inference
mobile robot
grammatical inference
inference process
probabilistic inference
logic programs
graphical models
hidden markov models
pairwise
digital libraries
database systems
three dimensional
real world