Making Small Language Models Better Multi-task Learners with Mixture-of-Task-Adapters.
Yukang XieChengyu WangJunbing YanJiyong ZhouFeiqi DengJun HuangPublished in: CoRR (2023)
Keyphrases
- language model
- multi task
- mixture model
- language modeling
- multi task learning
- document retrieval
- learning tasks
- probabilistic model
- n gram
- retrieval model
- learning experience
- sparse learning
- statistical language models
- feature selection
- information retrieval
- multiple tasks
- learning environment
- test collection
- language modelling
- query expansion
- transfer learning
- multi class
- language models for information retrieval
- learning process
- expectation maximization
- learning problems
- smoothing methods
- learning styles
- gaussian processes
- relevance model
- data mining
- spoken term detection
- unsupervised learning
- information retrieval systems
- active learning
- machine learning