Enabling Efficient Batch Serving for LMaaS via Generation Length Prediction.

Ke Cheng Wen Hu Zhi Wang Peng Du Jianguo Li Sheng Zhang

Published in: CoRR (2024)

Keyphrases

prediction accuracy
artificial intelligence
quality prediction
prediction algorithm
clustering algorithm
wireless sensor networks
prediction model
online algorithms