LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding.

Mostafa Elhoushi Akshat Shrivastava Diana Liskovich Basil Hosmer Bram Wasti Liangzhen Lai Anas Mahmoud Bilge Acun Saurabh Agarwal Ahmed Roman Ahmed A Aly Beidi Chen Carole-Jean Wu

Published in: ACL (1) (2024)

Keyphrases