Adaptive Attention for Sparse-based Long-sequence Transformer.

Xuanyu Zhang Zhepeng Lv Qing Yang

Published in: ACL (Findings) (2023)

Keyphrases

fuzzy logic
high dimensional
sparse data
sparse representation
visual attention
random projections
data mining
information retrieval
information systems
multiscale
multiresolution
data driven
power system
focus of attention
adaptive filtering
power transformers