Addressing token uniformity in transformers via singular value transformation.

Hanqi Yan Lin Gui Wenjie Li Yulan He

Published in: UAI (2022)

Keyphrases

gene expression data
singular values
singular value decomposition
low rank
fundamental matrix
neural network
viewpoint
linear combination
computer vision