Pruning Pre-trained Language Models with Principled Importance and Self-regularization.
Siyu RenKenny Q. ZhuPublished in: ACL (Findings) (2023)
Keyphrases
- language model
- pre trained
- language modeling
- probabilistic model
- n gram
- retrieval model
- information retrieval
- training data
- language modelling
- speech recognition
- document retrieval
- training examples
- smoothing methods
- statistical language models
- test collection
- control signals
- document ranking
- query expansion
- relevance model
- language models for information retrieval
- machine learning
- multi modal
- semi supervised
- pairwise