Cascade Speculative Drafting for Even Faster LLM Inference.

Ziyi Chen Xiaocong Yang Jiacheng Lin Chenkai Sun Jie Huang Kevin Chen-Chuan Chang

Published in: CoRR (2023)

Keyphrases

computer aided
inference process
bayesian networks
neural network
bayesian inference
probabilistic reasoning
bayesian model
efficient learning
artificial intelligence
decision trees
multiscale
probability distribution
markov random field
detection method
computer aided design