Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.
Zhenyu ZhangAjay JaiswalLu YinShiwei LiuJiawei ZhaoYuandong TianZhangyang WangPublished in: CoRR (2024)
Keyphrases
- low rank
- matrix factorization
- missing data
- convex optimization
- linear combination
- singular value decomposition
- matrix completion
- low rank matrix
- semi supervised
- rank minimization
- matrix decomposition
- trace norm
- high order
- high dimensional data
- regularized regression
- minimization problems
- robust principal component analysis
- singular values
- collaborative filtering
- negative matrix factorization
- nearest neighbor
- pattern recognition
- rank constraint
- learning algorithm