dLoRA: Dynamically Orchestrating Requests and Adapters for LoRA LLM Serving.

Bingyang Wu Ruidong Zhu Zili Zhang Peng Sun Xuanzhe Liu Xin Jin

Published in: OSDI (2024)

Keyphrases

agent technology
input output
database
genetic algorithm
software agents
data sets
information retrieval
artificial intelligence
computer vision
image processing
multi agent systems
information technology
operating system
tcp ip