Task-specific Compression for Multi-task Language Models using Attribution-based Pruning.
Nakyeong YangYunah JangHwanhee LeeSeohyeong JeongKyomin JungPublished in: EACL (Findings) (2023)
Keyphrases
- language model
- multi task
- multi task learning
- language modeling
- learning tasks
- n gram
- probabilistic model
- document retrieval
- test collection
- transfer learning
- multi class
- multiple tasks
- query expansion
- learning problems
- retrieval model
- information retrieval
- sparse learning
- language modelling
- gaussian processes
- smoothing methods
- statistical language models
- feature selection
- language models for information retrieval
- relevance model
- kernel methods
- information gain
- image features
- information extraction
- learning algorithm