OLoRA: Orthonormal Low-Rank Adaptation of Large Language Models.
Kerim BüyükakyüzPublished in: CoRR (2024)
Keyphrases
- language model
- low rank
- singular value decomposition
- language modeling
- matrix factorization
- probabilistic model
- low rank matrix
- linear combination
- matrix completion
- information retrieval
- convex optimization
- missing data
- document retrieval
- rank minimization
- n gram
- semi supervised
- query expansion
- test collection
- high dimensional data
- high order
- retrieval model
- least squares
- trace norm
- latent semantic indexing
- smoothing methods
- data sets
- query terms
- principal component analysis
- denoising
- information retrieval systems
- dimensionality reduction
- language models for information retrieval
- image classification