A Cheap Linear Attention Mechanism with Fast Lookups and Fixed-Size Representations.

Alexandre de Brébisson Pascal Vincent

Published in: CoRR (2016)

Keyphrases

fixed size
attention mechanism
sliding window
variable size
visual attention
higher level
window size
saliency map
data streams
reservoir sampling