Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization.
Yixin JiYang XiangJuntao LiWei ChenZhongyi LiuKehai ChenMin ZhangPublished in: CoRR (2024)
Keyphrases
- language model
- low rank
- language modeling
- linear combination
- missing data
- convex optimization
- matrix factorization
- probabilistic model
- document retrieval
- matrix completion
- low rank matrix
- n gram
- rank minimization
- query expansion
- high dimensional data
- singular value decomposition
- information retrieval
- trace norm
- semi supervised
- high order
- retrieval model
- vector space model
- test collection
- smoothing methods
- language models for information retrieval
- small number
- image features
- decision trees
- collaborative filtering
- nearest neighbor
- norm minimization
- learning algorithm
- machine learning
- data sets