How Does Perfect Fitting Affect Representation Learning? On the Training Dynamics of Representations in Deep Neural Networks.
Yuval SharonYehuda DarPublished in: CoRR (2024)
Keyphrases
- neural network
- deep architectures
- learning algorithm
- supervised learning
- recurrent networks
- reinforcement learning
- multiple representations
- learning speed
- error back propagation
- learning process
- learning systems
- connectionist systems
- feedforward neural networks
- learning problems
- feature hierarchies
- training process
- structured prediction
- learning rules
- neural nets
- incremental learning
- online learning
- pattern recognition
- machine learning
- representation scheme
- recurrent neural networks
- intelligent tutoring systems
- radial basis function network
- training samples
- unsupervised learning
- online training
- computer based training
- deep belief networks
- least squares
- object recognition