LSG Attention: Extrapolation of Pretrained Transformers to Long Sequences.

Charles Condevaux Sébastien Harispe

Published in: PAKDD (1) (2023)

Keyphrases

long sequences
data streams
mining sequential patterns
expert systems
multi dimensional
database
data sets
databases
neural network
case study
three dimensional
cooperative
support vector
probabilistic model
incomplete data