ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation.
Yurun SongJunchen ZhaoIan G. HarrisSangeetha Abdu JyothiPublished in: CoRR (2024)
Keyphrases
- fine tuning
- language model
- low rank
- rank minimization
- low rank matrix
- language modeling
- n gram
- convex optimization
- information retrieval
- probabilistic model
- matrix completion
- query expansion
- retrieval model
- missing data
- singular value decomposition
- linear combination
- test collection
- matrix factorization
- semi supervised
- high order
- mixture model
- dirichlet prior
- data mining
- high dimensional data
- dimensionality reduction
- least squares
- active learning
- face recognition