Attribution-based Task-specific Pruning for Multi-task Language Models.
Nakyeong YangYunah JangHwanhee LeeSeohyeong JungKyomin JungPublished in: CoRR (2022)
Keyphrases
- language model
- multi task
- multi task learning
- language modeling
- learning tasks
- n gram
- multi class
- probabilistic model
- retrieval model
- multiple tasks
- document retrieval
- information retrieval
- language modelling
- gaussian processes
- statistical language models
- feature selection
- learning problems
- test collection
- sparse learning
- query expansion
- smoothing methods
- transfer learning
- language models for information retrieval
- relevance model
- document ranking
- unsupervised learning
- supervised learning
- information gain
- feature space
- bayesian networks
- learning algorithm