SMDP-Based Dynamic Batching for Efficient Inference on GPU-Based Platforms.

Yaodan Xu Jingzhou Sun Sheng Zhou Zhisheng Niu

Published in: ICC (2023)

Keyphrases

efficient inference
probabilistic inference
conditional random fields
hidden variables
neural network
decision making
random walk
exact inference
reinforcement learning
maximum likelihood
approximate inference
markov networks
human pose estimation
fully connected