SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression.
Xin WangYu ZhengZhongwei WanMi ZhangPublished in: CoRR (2024)
Keyphrases
- singular value decomposition
- language model
- language modeling
- document retrieval
- n gram
- information retrieval
- dimension reduction
- least squares
- probabilistic model
- dimensionality reduction
- mixture model
- test collection
- singular values
- low rank
- latent semantic indexing
- principal component analysis
- query expansion
- query terms
- data matrix
- retrieval model
- document representation
- relevance model
- low rank approximation
- latent semantic analysis
- image retrieval
- translation model
- machine learning
- web search
- singular vectors
- computer vision
- feature selection
- image processing