Login / Signup
Speculative Decoding via Early-exiting for Faster LLM Inference with Thompson Sampling Control Mechanism.
Jiahao Liu
Qifan Wang
Jingang Wang
Xunliang Cai
Published in:
CoRR (2024)
Keyphrases
</>
gibbs sampler
markov chain monte carlo
random sampling
random fields
bayesian inference
inference mechanism
metropolis hastings
inference process
bayesian networks
monte carlo
sampling strategy
markov chain
importance sampling
exact inference
decision trees
machine learning
decoding process
data sets