GQKVA: Efficient Pre-training of Transformers by Grouping Queries, Keys, and Values.

Farnoosh Javadi Walid Ahmed Habib Hajimolahoseini Foozhan Ataiefard Mohammad Hassanpour Saina Asani Austin Wen Omar Mohamed Awad Kangling Liu Yang Liu

Published in: CoRR (2023)

Keyphrases