ReLoRA: High-Rank Training Through Low-Rank Updates.
Vladislav LialinSherin MuckatiraNamrata ShivagundeAnna RumshiskyPublished in: ICLR (2024)
Keyphrases
- low rank
- frobenius norm
- convex optimization
- matrix factorization
- low rank matrix
- matrix completion
- linear combination
- nuclear norm
- missing data
- rank minimization
- singular values
- singular value decomposition
- semi supervised
- kernel matrix
- low rank approximation
- high dimensional data
- high order
- trace norm
- matrix decomposition
- stochastic gradient descent
- ranked list
- low rank matrices
- non rigid structure from motion
- machine learning
- robust principal component analysis
- data matrix
- supervised learning
- training samples
- image classification
- rank constraint
- training set
- pattern recognition