Is Attention Better Than Matrix Decomposition?

Zhengyang Geng Meng-Hao Guo Hongxu Chen Xia Li Ke Wei Zhouchen Lin

Published in: CoRR (2021)

Keyphrases

matrix decomposition
low rank
nonnegative matrix factorization
low rank matrix
singular value decomposition
data matrix
higher order
linear combination
singular values