Fast Inference from Transformers via Speculative Decoding.

Yaniv Leviathan Matan Kalman Yossi Matias

Published in: ICML (2023)

Keyphrases

bayesian inference
probabilistic inference
bayesian networks
inference process
inference problems
decision trees
belief networks
inference engine
grammatical inference
genetic algorithm
structured prediction
inference mechanism