Computational Limits of Low-Rank Adaptation (LoRA) for Transformer-Based Models.
Jerry Yao-Chieh HuMaojiang SuEn-Jui KuoZhao SongHan LiuPublished in: CoRR (2024)
Keyphrases
- minimization problems
- low rank
- missing data
- linear combination
- matrix completion
- matrix factorization
- low rank matrix recovery
- convex optimization
- singular value decomposition
- semi supervised
- low rank matrix
- rank minimization
- factorization methods
- matrix decomposition
- high dimensional data
- input image
- small number
- trace norm