Algorithmic Regularization in Over-parameterized Matrix Sensing and Neural Networks with Quadratic Activations.
Yuanzhi LiTengyu MaHongyang ZhangPublished in: COLT (2018)
Keyphrases
- neural network
- trace norm
- rank minimization
- pattern recognition
- penalized likelihood
- penalty functions
- matrix valued
- pairwise
- artificial neural networks
- hopfield neural network
- linear matrix inequality
- semidefinite
- symmetric matrix
- self organizing maps
- covariance matrix
- real time
- recurrent neural networks
- fuzzy systems
- neural network model
- multilayer perceptron
- objective function
- back propagation
- boltzmann distribution
- computational complexity
- fuzzy logic
- fault diagnosis
- singular value decomposition
- linear algebra
- prior information
- singular values
- valued data
- sufficient conditions
- kernel matrices
- least squares
- sensor networks
- semidefinite programming
- low rank
- neural nets