Is Attention Better Than Matrix Decomposition?

Zhengyang Geng Meng-Hao Guo Hongxu Chen Xia Li Ke Wei Zhouchen Lin

Published in: ICLR (2021)

Keyphrases

matrix decomposition
low rank
nonnegative matrix factorization
singular value decomposition
singular values
low rank matrix
similarity measure
principal component analysis
data representation
latent structure