Conveyor: Efficient Tool-aware LLM Serving with Tool Partial Execution.

Yechen Xu Xinhao Kong Tingjun Chen Danyang Zhuo

Published in: CoRR (2024)

Keyphrases

real time
software tools
data sets
feature selection
case study
reinforcement learning
relational databases
mobile robot
computationally efficient
test cases
cost effective