Efficient Sparse Attention needs Adaptive Token Release.

Chaoran Zhang Lixin Zou Dan Luo Xiangyang Luo Zihao Li Min Tang Chenliang Li

Published in: ACL (Findings) (2024)

Keyphrases

database
lightweight
cost effective
databases
signal processing
neural network
information retrieval
genetic algorithm
social networks
data driven
computationally efficient
computationally expensive
sparse coding
random projections