LQ-LoRA: Low-rank Plus Quantized Matrix Decomposition for Efficient Language Model Finetuning.
Han GuoPhilip GreengardEric P. XingYoon KimPublished in: CoRR (2023)
Keyphrases
- low rank
- matrix decomposition
- language model
- low rank matrix
- missing data
- linear combination
- convex optimization
- nonnegative matrix factorization
- matrix factorization
- singular value decomposition
- singular values
- probabilistic model
- information retrieval
- high dimensional data
- kernel matrix
- semi supervised
- high order
- low rank approximation
- em algorithm
- markov random field
- least squares
- data matrix
- data summarization