ALPS: Improved Optimization for Highly Sparse One-Shot Pruning for Large Language Models.

Xiang Meng Kayhan Behdin Haoyue Wang Rahul Mazumder

Published in: CoRR (2024)

Keyphrases

language model
language modeling
n gram
probabilistic model
information retrieval
retrieval model
test collection

document retrieval
speech recognition
language modelling
query expansion
high dimensional
statistical language models
language models for information retrieval

smoothing methods
query terms
relevance model
context sensitive
ad hoc information retrieval
language model for information retrieval

document ranking
pseudo relevance feedback
passage retrieval
query processing
spoken term detection
clustering algorithm