MELoRA: Mini-Ensemble Low-Rank Adapters for Parameter-Efficient Fine-Tuning.
Pengjie RenChengshun ShiShiguang WuMengqi ZhangZhaochun RenMaarten de RijkeZhumin ChenJiahuan PeiPublished in: ACL (1) (2024)
Keyphrases
- low rank
- fine tuning
- matrix factorization
- singular value decomposition
- missing data
- low rank matrix
- linear combination
- matrix completion
- convex optimization
- high order
- rank minimization
- non rigid structure from motion
- neural network
- fine tuned
- kernel matrix
- learning algorithm
- data matrix
- high dimensional data
- pairwise
- training set