On the Expressive Flexibility of Self-Attention Matrices.

Valerii Likhosherstov Krzysztof Choromanski Adrian Weller

Published in: AAAI (2023)

Keyphrases

databases
computer vision
singular value decomposition
visual attention
neural network
e learning
decision trees
case study
singular values
pairwise comparison