Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Models.
Emre OnalKlemens FlögeEmma CaldwellArsen SheverdinVincent FortuinPublished in: CoRR (2024)
Keyphrases
- language model
- low rank
- language modeling
- convex optimization
- maximum likelihood
- linear combination
- missing data
- matrix factorization
- n gram
- rank minimization
- low rank matrix
- retrieval model
- singular value decomposition
- document retrieval
- probabilistic model
- query expansion
- high dimensional data
- matrix completion
- semi supervised
- information retrieval
- high order
- test collection
- query terms
- mixture model
- bayesian networks
- trace norm
- pattern recognition
- recommender systems
- vector space model
- data sets