ATTACC the Quadratic Bottleneck of Attention Layers.

Sheng-Chun Kao Suvinay Subramanian Gaurav Agrawal Tushar Krishna

Published in: CoRR (2021)

Keyphrases

pairwise
multi layer
computational complexity
special case
neural network
learning algorithm
high level
objective function
multi agent
artificial neural networks
focus of attention