Basis Selection: Low-Rank Decomposition of Pretrained Large Language Models for Target Applications.
Yang LiChangsheng ZhaoHyungtak LeeErnie ChangYangyang ShiVikas ChandraPublished in: CoRR (2024)
Keyphrases
- language model
- low rank
- language modeling
- convex optimization
- tensor decomposition
- missing data
- matrix factorization
- linear combination
- matrix completion
- n gram
- singular value decomposition
- probabilistic model
- rank minimization
- low rank matrix
- document retrieval
- information retrieval
- retrieval model
- high dimensional data
- query expansion
- smoothing methods
- semi supervised
- high order
- test collection
- relevance model
- vector space model
- trace norm
- query terms
- language models for information retrieval
- generative model
- pattern recognition
- machine learning