Is Sparse Attention more Interpretable?

Clara Meister Stefan Lazov Isabelle Augenstein Ryan Cotterell

Published in: ACL/IJCNLP (2) (2021)

Keyphrases

high dimensional
dictionary learning
sparse representation
compressive sensing

real time
genetic algorithm
database systems
data structure

evolutionary algorithm
multiresolution
visual attention

sparse coding
sparse data
sparse matrix