From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients.
Ajay JaiswalLu YinZhenyu ZhangShiwei LiuJiawei ZhaoYuandong TianZhangyang WangPublished in: CoRR (2024)
Keyphrases
- low rank
- linear combination
- missing data
- matrix factorization
- convex optimization
- low rank matrix
- singular value decomposition
- matrix decomposition
- semi supervised
- kernel matrix
- matrix completion
- high dimensional data
- high order
- rank minimization
- trace norm
- singular values
- affinity matrix
- low rank representation
- low rank matrices
- robust principal component analysis
- low rank approximation
- data matrix
- minimization problems
- image restoration
- super resolution
- collaborative filtering
- data points
- data mining
- neural network