Rethinking Pruning Large Language Models: Benefits and Pitfalls of Reconstruction Error Minimization.
Sungbin ShinWonpyo ParkJaeho LeeNamhoon LeePublished in: CoRR (2024)
Keyphrases
- language model
- error minimization
- language modeling
- least squares
- n gram
- probabilistic model
- information retrieval
- speech recognition
- document retrieval
- retrieval model
- squared error
- language modelling
- query expansion
- test collection
- mixture model
- statistical language models
- singular value decomposition
- language models for information retrieval
- objective function
- smoothing methods
- statistical language modeling
- error rate
- high dimensional