RoseLoRA: Row and Column-wise Sparse Low-rank Adaptation of Pre-trained Language Model for Knowledge Editing and Fine-tuning.
Haoyu WangTianci LiuTuo ZhaoJing GaoPublished in: CoRR (2024)
Keyphrases
- language model
- fine tuning
- low rank
- binary matrices
- binary matrix
- data matrix
- rank minimization
- low rank matrix
- pre trained
- speech recognition
- probabilistic model
- missing data
- linear combination
- matrix factorization
- information retrieval
- convex optimization
- singular value decomposition
- high order
- rows and columns
- high dimensional data
- data sets
- semi supervised
- small number
- high dimensional
- pairwise
- neural network
- image classification
- data analysis
- pattern recognition
- bayesian networks
- decision trees
- machine learning