Matrix-Transformation Based Low-Rank Adaptation (MTLoRA): A Brain-Inspired Method for Parameter-Efficient Fine-Tuning.
Yao LiangYuwei WangYang LiYi ZengPublished in: CoRR (2024)
Keyphrases
- fine tuning
- low rank
- trace norm
- rank minimization
- matrix factorization
- missing data
- factorization methods
- singular value decomposition
- pattern recognition
- matrix completion
- higher order
- small number
- pairwise
- matrix decomposition
- low rank matrix
- minimization problems
- ell norm
- affinity matrix
- eigendecomposition
- kernel matrix
- high order
- linear combination
- least squares
- knn