Transformers need glasses! Information over-squashing in language tasks.

Federico Barbero Andrea Banino Steven Kapturowski Dharshan Kumaran João G. M. Araújo Alex Vitvitskyi Razvan Pascanu Petar Velickovic

Published in: CoRR (2024)

Keyphrases