Making Small Language Models Better Multi-task Learners with Mixture-of-Task-Adapters.
Yukang XieChengyu WangJunbing YanJiyong ZhouFeiqi DengJun HuangPublished in: WSDM (2024)
Keyphrases
- language model
- multi task
- mixture model
- language modeling
- multi task learning
- learning tasks
- probabilistic model
- multiple tasks
- n gram
- document retrieval
- retrieval model
- learning experience
- language modelling
- query expansion
- sparse learning
- information retrieval
- smoothing methods
- test collection
- multi class
- statistical language models
- gaussian processes
- e learning
- learning environment
- learning styles
- learning problems
- learning process
- relevance model
- feature selection
- machine learning
- expectation maximization
- graphical models
- learning algorithm
- language models for information retrieval