Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention.

Angelos Katharopoulos Apoorv Vyas Nikolaos Pappas François Fleuret

Published in: CoRR (2020)

Keyphrases

autoregressive
moving average
non stationary
gaussian markov random field
recurrent neural networks
random fields
random field models
sar images
spectrum analysis
autoregressive model
multiscale