ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language Models.
Zequan LiuJiawen LynWei ZhuXing TianYvette GrahamPublished in: NAACL-HLT (2024)
Keyphrases
- fine tuning
- language model
- low rank
- language modeling
- missing data
- matrix factorization
- convex optimization
- linear combination
- low rank matrix
- semi supervised
- speech recognition
- document retrieval
- matrix completion
- n gram
- singular value decomposition
- high order
- rank minimization
- query expansion
- test collection
- probabilistic model
- retrieval model
- information retrieval
- language models for information retrieval
- high dimensional data
- trace norm
- vector space model
- query terms
- collaborative filtering
- smoothing methods
- pattern recognition
- recommender systems
- pairwise
- similarity measure