Optimal Block-Level Draft Verification for Accelerating Speculative Decoding.

Ziteng Sun Jae Hun Ro Ahmad Beirami Ananda Theertha Suresh

Published in: CoRR (2024)

Keyphrases

model checking
dynamic programming
multiscale
optimal design
multi agent
worst case
real time
databases
machine learning
optimal solution
hidden markov models
closed form
optimal control
asymptotically optimal
finding optimal
signature verification