X-LoRA: Mixture of Low-Rank Adapter Experts, a Flexible Framework for Large Language Models with Applications in Protein Mechanics and Design.
Eric L. BuehlerMarkus J. BuehlerPublished in: CoRR (2024)
Keyphrases
- language model
- low rank
- mixture model
- language modeling
- n gram
- matrix factorization
- probabilistic model
- convex optimization
- information retrieval
- singular value decomposition
- semi supervised
- generative model
- linear combination
- high order
- smoothing methods
- vector space model
- low rank matrix
- test collection
- rank minimization
- retrieval model
- web search
- nearest neighbor
- high dimensional
- decision trees