SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning.

Hanrui Wang Zhekai Zhang Song Han

Published in: CoRR (2020)

Keyphrases

real time
tree construction
database
linear combination
visual attention
pruning strategy
visual field
neural network
learning algorithm
case study
object recognition
search space
lightweight
software architecture