Exact solutions to the nonlinear dynamics of learning in deep linear neural networks.
Andrew M. SaxeJames L. McClellandSurya GanguliPublished in: ICLR (2014)
Keyphrases
- neural network
- nonlinear dynamics
- learning algorithm
- learning process
- neural nets
- learning systems
- connectionist systems
- incremental learning
- learning tasks
- online learning
- artificial neural networks
- pattern recognition
- unsupervised learning
- sufficient conditions
- recurrent neural networks
- supervised learning
- training process
- learning rules
- deep learning
- error back propagation