SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning.

Hanrui Wang Zhekai Zhang Song Han

Published in: HPCA (2021)

Keyphrases

real time
data sets
search space
management system
software architecture
computationally expensive
tree construction
database
genetic algorithm
website
visual attention
head pose estimation
avoid overfitting
effective pruning