Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention.

Angelos Katharopoulos Apoorv Vyas Nikolaos Pappas François Fleuret

Published in: ICML (2020)

Keyphrases

autoregressive
moving average
non stationary
random fields
recurrent neural networks
autoregressive model
gaussian markov random field
random field models
sar images
markov random field
spectrum analysis
machine learning
optical flow
semi supervised
image reconstruction
autoregressive moving average