CascadeServe: Unlocking Model Cascades for Inference Serving.

Ferdi Kossmann Ziniu Wu Alex Turk Nesime Tatbul Lei Cao Samuel Madden

Published in: CoRR (2024)

Keyphrases

computational model
probabilistic model
mathematical model
theoretical analysis
objective function
neural network model
genetic algorithm
control system
probability distribution
statistical model
experimental data
prediction model
inference engine
bayesian model