Efficient Sparse Attention needs Adaptive Token Release.

Chaoran Zhang Lixin Zou Dan Luo Min Tang Xiangyang Luo Zihao Li Chenliang Li

Published in: CoRR (2024)

Keyphrases

high dimensional
computationally expensive
data driven
data sets
information retrieval
vision system
lightweight
sparse coding
sparse data