Learning on Transformers is Provable Low-Rank and Sparse: A One-layer Analysis.

Hongkang Li Meng Wang Shuai Zhang Sijia Liu Pin-Yu Chen

Published in: CoRR (2024)

Keyphrases

learning algorithm
learning process
reinforcement learning
data analysis
active learning
feature space
prior knowledge
semi supervised
image reconstruction