Online Speculative Decoding.

Xiaoxuan Liu Lanxiang Hu Peter Bailis Ion Stoica Zhijie Deng Alvin Cheung Hao Zhang

Published in: CoRR (2023)

Keyphrases

online learning
real time
online environment
neural network
data mining
artificial intelligence
computer vision
information systems
website
similarity measure
information technology
virtual communities