Learn To be Efficient: Build Structured Sparsity in Large Language Models.

Haizhong Zheng Xiaoyan Bai Beidi Chen Fan Lai Atul Prakash

Published in: CoRR (2024)

Keyphrases

language model
language modeling
n gram
structured sparsity
probabilistic model
query expansion
retrieval model
information retrieval
learning algorithm
statistical learning
smoothing methods
language models for information retrieval