Interference-Aware Scheduling for Inference Serving.
Daniel MendozaFrancisco RomeroQian LiNeeraja J. YadwadkarChristos KozyrakisPublished in: EuroMLSys@EuroSys (2021)
Keyphrases
- scheduling problem
- scheduling algorithm
- probabilistic inference
- resource allocation
- round robin
- data sets
- bayesian networks
- inference process
- multipath
- resource constraints
- bayesian inference
- database
- dynamic bayesian networks
- bayesian model
- efficient learning
- structured prediction
- resource utilization
- belief networks
- graphical models
- flexible manufacturing systems
- dynamic scheduling
- scheduling strategy