QoS Optimization of DNN Serving Systems Based on Per-Request Latency Characteristics.

Jianfeng Zhang Wensheng Zhang Lingjun Pu Jingdong Xu

Published in: MSN (2020)

Keyphrases

building blocks
data sets
management system
optimization problems
computer systems
learning systems
quality of service
retrieval systems
response time
resource management
real time
complex systems
power consumption
global optimization
service differentiation
desirable characteristics