Sparse Attention with Linear Units.

Biao Zhang Ivan Titov Rico Sennrich

Published in: EMNLP (1) (2021)

Keyphrases

website
sparse matrix
regularized least squares
multiscale
sparse data
linear systems
sparse representation
visual attention
eigenvalue decomposition
data mining
compressed sensing
linear models
dictionary learning
natural images
sufficient conditions
objective function
case study
decision trees
social networks