LSG Attention: Extrapolation of pretrained Transformers to long sequences.

Charles Condevaux Sébastien Harispe

Published in: CoRR (2022)

Keyphrases

long sequences
mining sequential patterns
data streams
decision trees
image segmentation
multiscale
multi dimensional
information retrieval
image processing
similarity measure
learning environment
evolutionary algorithm
multiresolution
visual attention
saliency map