Pruning Pre-trained Language Models with Principled Importance and Self-regularization.
Siyu RenKenny Q. ZhuPublished in: CoRR (2023)
Keyphrases
- language model
- pre trained
- language modeling
- n gram
- training data
- query expansion
- probabilistic model
- document retrieval
- language modelling
- retrieval model
- information retrieval
- speech recognition
- statistical language models
- test collection
- training examples
- language models for information retrieval
- smoothing methods
- data sets
- control signals
- visual tracking