SDSAT: Accelerating LLM Inference through Speculative Decoding with Semantic Adaptive Tokens.

Chengbo Liu Yong Zhu

Published in: CoRR (2024)

Keyphrases

natural language
semantic web
semantic analysis
semantic information
probabilistic inference
semantic features
semantically meaningful
semantic level
semantic annotation
belief networks
context dependent
semantic web technologies
semantic search
semantic content
semantic representation
inference process