USHER: Holistic Interference Avoidance for Resource Optimized ML Inference.

Sudipta Saha Shubha Haiying Shen Anand Iyer

Published in: OSDI (2024)

Keyphrases

maximum likelihood
resource allocation
belief networks
probabilistic inference
resource management
bayesian inference
multipath
case study
data sets
decision trees
image segmentation
graphical models
conditional random fields
random fields
structured prediction
inference process