Bayesian low-rank adaptation for large language models.
Adam X. YangMaxime RobeynsXi WangLaurence AitchisonPublished in: CoRR (2023)
Keyphrases
- language model
- low rank
- language modeling
- missing data
- convex optimization
- linear combination
- matrix completion
- singular value decomposition
- matrix factorization
- n gram
- retrieval model
- document retrieval
- low rank matrix
- test collection
- rank minimization
- high order
- information retrieval
- semi supervised
- probabilistic model
- high dimensional data
- query expansion
- mixture model
- query terms
- vector space model
- smoothing methods
- maximum likelihood
- language models for information retrieval
- bayesian networks
- trace norm
- active learning
- information retrieval systems
- dimensionality reduction
- higher order
- low dimensional
- pattern recognition
- data mining