Learning dynamics of gradient descent optimization in deep neural networks.
Wei WuXiaoyuan JingWencai DuGuoliang ChenPublished in: Sci. China Inf. Sci. (2021)
Keyphrases
- neural network
- learning algorithm
- learning process
- optimization algorithm
- recurrent networks
- learning rules
- learning systems
- learning scheme
- connectionist systems
- recurrent neural networks
- global optimization
- neural nets
- cost function
- prior knowledge
- artificial neural networks
- pattern recognition
- decision trees
- kernel machines
- cascade correlation
- back propagation
- learning analytics
- dynamic model
- learning problems
- learning tasks
- training set
- reinforcement learning
- bayesian networks
- genetic algorithm
- machine learning