Adaptive Attention Span in Transformers.

Sainbayar Sukhbaatar Edouard Grave Piotr Bojanowski Armand Joulin

Published in: ACL (1) (2019)

Keyphrases

visual attention
adaptive systems
three dimensional
probabilistic model
real time
neural network
real world
information systems
multimedia
support vector
expert systems
image compression
data driven
focus of attention
selective attention