Do Transformers Need Deep Long-Range Memory?

Jack W. Rae Ali Razavi

Published in: ACL (2020)

Keyphrases

long range
short range
long range correlations
conditional random fields
fractional brownian motion
memory requirements
long range interactions
pairwise
optical flow
rigid and non rigid
neural network
machine learning
hidden markov models
figure ground
partial discharge