Mixture-of-LoRAs: An Efficient Multitask Tuning for Large Language Models.
Wenfeng FengChuzhan HaoYuewei ZhangYu HanHao WangPublished in: CoRR (2024)
Keyphrases
- language model
- multi task
- mixture model
- language modeling
- multitask learning
- n gram
- speech recognition
- multi task learning
- document retrieval
- probabilistic model
- language modelling
- learning tasks
- retrieval model
- multiple tasks
- information retrieval
- statistical language models
- test collection
- query expansion
- smoothing methods
- learning problems
- multi class
- language models for information retrieval
- feature selection
- document ranking