The Surprising Simplicity of the Early-Time Learning Dynamics of Neural Networks.
Wei HuLechao XiaoBen AdlamJeffrey PenningtonPublished in: NeurIPS (2020)
Keyphrases
- neural network
- pattern recognition
- neural nets
- learning algorithm
- recurrent networks
- learning process
- supervised learning
- machine learning
- training process
- learning tasks
- online learning
- prior knowledge
- reinforcement learning
- unsupervised learning
- learning styles
- learning systems
- knowledge acquisition
- learning problems
- multilayer perceptron
- multi layer
- learning rules
- learning capabilities
- feedforward neural networks