Low-Rank Prune-And-Factorize for Language Model Compression.
Siyu RenKenny Q. ZhuPublished in: LREC/COLING (2024)
Keyphrases
- language model
- low rank
- language modeling
- convex optimization
- missing data
- linear combination
- matrix factorization
- matrix completion
- probabilistic model
- singular value decomposition
- low rank matrix
- n gram
- semi supervised
- information retrieval
- test collection
- query expansion
- retrieval model
- high order
- high dimensional data
- mixture model
- rank minimization
- query terms
- smoothing methods
- higher order
- maximum likelihood
- low dimensional
- active learning
- image processing