LoPT: Low-Rank Prompt Tuning for Parameter Efficient Language Models.
Shouchang GuoSonam DamaniKeng-hao ChangPublished in: CoRR (2024)
Keyphrases
- language model
- low rank
- language modeling
- convex optimization
- document retrieval
- probabilistic model
- missing data
- matrix factorization
- n gram
- information retrieval
- matrix completion
- test collection
- linear combination
- query expansion
- retrieval model
- singular value decomposition
- vector space model
- low rank matrix
- data sets
- trace norm
- rank minimization
- relevance model
- smoothing methods
- high dimensional data
- text classification
- image classification
- decision trees