Towards Robust Pruning: An Adaptive Knowledge-Retention Pruning Strategy for Language Models.
Jianwei LiQi LeiWei ChengDongkuan XuPublished in: CoRR (2023)
Keyphrases
- language model
- pruning strategy
- language modeling
- n gram
- information retrieval
- query expansion
- document retrieval
- test collection
- retrieval model
- probabilistic model
- language modelling
- mining algorithm
- statistical language models
- itemsets
- query terms
- frequent itemset mining
- bayesian classifier
- learning algorithm
- knowledge discovery
- data mining
- smoothing methods