Reducing DNN inference latency using DRL.

Suhwan Kim Sehun Jung Hyang-Won Lee

Published in: ICTC (2022)

Keyphrases

inference process
response time
low latency
probabilistic inference
prefetching
efficient learning
inference mechanism
belief networks
bayesian inference
decision theoretic
resource utilization