LCQ: Low-Rank Codebook based Quantization for Large Language Models.
Wen-Pu CaiWu-Jun LiPublished in: CoRR (2024)
Keyphrases
- language model
- low rank
- language modeling
- missing data
- n gram
- linear combination
- bag of words
- matrix factorization
- low rank matrix
- rank minimization
- convex optimization
- singular value decomposition
- information retrieval
- probabilistic model
- high order
- semi supervised
- matrix completion
- image representation
- query expansion
- test collection
- retrieval model
- high dimensional data
- feature vectors
- pattern recognition
- image processing
- nearest neighbor
- visual words
- least squares
- smoothing methods
- collaborative filtering
- data mining