RankAdaptor: Hierarchical Dynamic Low-Rank Adaptation for Structural Pruned LLMs.
Changhai ZhouShijie HanShiyang ZhangShichao WengZekai LiuCheng JinPublished in: CoRR (2024)
Keyphrases
- low rank
- matrix factorization
- linear combination
- missing data
- low rank matrix
- rank minimization
- convex optimization
- singular value decomposition
- high dimensional data
- kernel matrix
- matrix completion
- semi supervised
- high order
- trace norm
- neural network
- image processing
- low rank matrices
- multiscale
- data sets
- non rigid structure from motion
- robust principal component analysis