ProPD: Dynamic Token Tree Pruning and Generation for LLM Parallel Decoding.

Shuzhang Zhong Zebin Yang Meng Li Ruihao Gong Runsheng Wang Ru Huang

Published in: CoRR (2024)

Keyphrases

tree pruning
dynamic environments
computer architecture
parallel implementation
database
computer vision
decision making
web services
image quality