Training Neural Networks from Scratch with Parallel Low-Rank Adapters.
Minyoung HuhBrian CheungJeremy BernsteinPhillip IsolaPulkit AgrawalPublished in: CoRR (2024)
Keyphrases
- low rank
- neural network
- training process
- matrix factorization
- convex optimization
- missing data
- low rank matrix
- matrix completion
- linear combination
- singular value decomposition
- semi supervised
- matrix decomposition
- rank minimization
- kernel matrix
- high dimensional data
- pattern recognition
- singular values
- high order
- training set
- collaborative filtering
- low rank matrices
- non rigid structure from motion
- affinity matrix
- supervised learning
- trace norm
- machine learning
- minimization problems
- training samples
- computer vision
- semidefinite programming
- small number
- low rank representation
- robust principal component analysis