Sparse Low-rank Adaptation of Pre-trained Language Models.
Ning DingXingtai LvQiaosen WangYulin ChenBowen ZhouZhiyuan LiuMaosong SunPublished in: EMNLP (2023)
Keyphrases
- language model
- low rank
- pre trained
- low rank matrix
- rank minimization
- regularized regression
- convex optimization
- matrix factorization
- missing data
- linear combination
- probabilistic model
- semi supervised
- training data
- high order
- speech recognition
- singular value decomposition
- high dimensional data
- training examples
- information retrieval
- high dimensional
- sparse coding
- sparse matrix
- sparse representation
- active learning
- collaborative filtering
- small number