AdaMoLE: Fine-Tuning Large Language Models with Adaptive Mixture of Low-Rank Adaptation Experts.
Zefang LiuJiahua LuoPublished in: CoRR (2024)
Keyphrases
- fine tuning
- language model
- low rank
- mixture model
- language modeling
- convex optimization
- matrix factorization
- missing data
- linear combination
- n gram
- matrix completion
- probabilistic model
- document retrieval
- retrieval model
- rank minimization
- information retrieval
- low rank matrix
- singular value decomposition
- semi supervised
- query expansion
- smoothing methods
- expert finding
- high order
- trace norm
- high dimensional data
- test collection
- query terms
- language models for information retrieval
- collaborative filtering
- vector space model
- data sets
- text categorization
- nearest neighbor
- high dimensional
- image segmentation
- learning algorithm
- data mining