Transformer Acceleration with Dynamic Sparse Attention.

Liu Liu Zheng Qu Zhaodong Chen Yufei Ding Yuan Xie

Published in: CoRR (2021)

Keyphrases

fuzzy logic
dynamic environments
databases
least squares
real time
neural network
high dimensional
sparse representation
sparse data