Login / Signup

BASS: Batched Attention-optimized Speculative Sampling.

Haifeng QianSujan Kumar GonugondlaSungsoo HaMingyue ShangSanjay Krishna GoudaRamesh NallapatiSudipta SenguptaXiaofei MaAnoop Deoras
Published in: CoRR (2024)
Keyphrases