BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models.
Yibin WangHaizhou ShiLigong HanDimitris N. MetaxasHao WangPublished in: CoRR (2024)
Keyphrases
- language model
- low rank
- back propagation
- language modeling
- artificial neural networks
- neural network
- convex optimization
- missing data
- linear combination
- singular value decomposition
- matrix factorization
- n gram
- probabilistic model
- learning algorithm
- information retrieval
- semi supervised
- high order
- query expansion
- retrieval model
- test collection
- smoothing methods
- high dimensional data
- fuzzy logic
- bayesian networks
- active learning
- high dimensional
- data mining
- expectation maximization
- maximum likelihood
- dimensionality reduction
- web search
- supervised learning
- data clustering
- feature extraction
- data sets