ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language Models.
Zequan LiuJiawen LynWei ZhuXing TianYvette GrahamPublished in: CoRR (2024)
Keyphrases
- fine tuning
- language model
- low rank
- language modeling
- convex optimization
- missing data
- matrix factorization
- linear combination
- n gram
- singular value decomposition
- query expansion
- low rank matrix
- probabilistic model
- rank minimization
- document retrieval
- information retrieval
- matrix completion
- retrieval model
- high dimensional data
- speech recognition
- high order
- semi supervised
- test collection
- relevance model
- language models for information retrieval
- query terms
- vector space model
- trace norm
- smoothing methods
- high dimensional
- feature extraction
- data sets
- low dimensional
- co occurrence
- small number
- image retrieval
- pairwise
- decision trees