Green Carbon Footprint for Model Inference Serving via Exploiting Mixed-Quality Models and GPU Partitioning.
Baolin LiSiddharth SamsiVijay GadepallyDevesh TiwariPublished in: CoRR (2023)
Keyphrases
- probabilistic model
- parameter estimation
- real time
- generic model
- bayesian framework
- mathematical models
- neural network
- linear model
- neural network model
- modeling framework
- computational model
- analytical model
- prior knowledge
- modeling method
- predictive model
- linear models
- multiple models
- prediction model
- learning models
- random fields
- classification models
- statistical model
- mathematical model
- computational models
- conceptual model
- markov chain monte carlo
- experimental data
- markov chain
- image quality
- inference process
- general purpose
- factor graphs
- gibbs sampler