Fast Inference from Transformers via Speculative Decoding.

Yaniv Leviathan Matan Kalman Yossi Matias

Published in: CoRR (2022)

Keyphrases

bayesian networks
bayesian inference
database
data sets
inference process
social networks
probabilistic inference
dynamic bayesian networks
bayesian model
decoding algorithm
real world
expert systems
probabilistic model