Sparse Low-rank Adaptation of Pre-trained Language Models.
Ning DingXingtai LvQiaosen WangYulin ChenBowen ZhouZhiyuan LiuMaosong SunPublished in: CoRR (2023)
Keyphrases
- language model
- low rank
- pre trained
- low rank matrix
- rank minimization
- regularized regression
- convex optimization
- matrix factorization
- missing data
- linear combination
- training data
- singular value decomposition
- high order
- probabilistic model
- information retrieval
- high dimensional data
- speech recognition
- semi supervised
- training examples
- high dimensional
- data sets
- collaborative filtering
- pairwise
- sparse matrix
- data analysis
- semi supervised learning
- sparse coding
- decision trees
- computer vision
- machine learning