Is Sparse Attention more Interpretable?

Clara Meister Stefan Lazov Isabelle Augenstein Ryan Cotterell

Published in: ACL/IJCNLP (2) (2021)

Keyphrases

high dimensional
dictionary learning
sparse representation
compressive sensing
real time
genetic algorithm
database systems
data structure
evolutionary algorithm
multiresolution
visual attention
sparse coding
sparse data
sparse matrix