Login / Signup
Transformers need glasses! Information over-squashing in language tasks.
Federico Barbero
Andrea Banino
Steven Kapturowski
Dharshan Kumaran
João G. M. Araújo
Alex Vitvitskyi
Razvan Pascanu
Petar Velickovic
Published in:
CoRR (2024)
Keyphrases
</>
information extraction
structural information
database
information processing
information content
data sets
video sequences
natural language
prior knowledge
information sources
web documents
spatial information
daily life