Low-rank Gradient Approximation For Memory-Efficient On-device Training of Deep Neural Network.
Mary GooneratneKhe Chai SimPetr ZadrazilAndreas KabelFrançoise BeaufaysGiovanni MottaPublished in: CoRR (2020)
Keyphrases
- memory efficient
- low rank
- neural network
- matrix decomposition
- training process
- matrix factorization
- convex optimization
- missing data
- linear combination
- low rank matrix
- semi supervised
- matrix completion
- singular value decomposition
- rank minimization
- high dimensional data
- low rank approximation
- singular values
- trace norm
- kernel matrix
- low rank matrices
- training set
- data matrix
- high order
- minimization problems
- pattern recognition
- missing values
- pairwise
- approximation methods
- robust principal component analysis
- non rigid structure from motion
- low dimensional
- image segmentation