Anisotropy Is Inherent to Self-Attention in Transformers.

Nathan Godey Éric Villemonte de la Clergerie Benoît Sagot

Published in: EACL (1) (2024)

Keyphrases

data sets
three dimensional
selective attention
database
real world
multiscale
input image
visual attention