The Dynamics of Gradient Descent for Overparametrized Neural Networks.
Siddhartha SatpathiR. SrikantPublished in: CoRR (2021)
Keyphrases
- neural network
- pattern recognition
- cost function
- artificial neural networks
- recurrent networks
- dynamic model
- dynamical systems
- learning rules
- multi layer
- fuzzy logic
- neural network model
- objective function
- machine learning
- nonlinear dynamics
- rule extraction
- genetic algorithm
- activation function
- training algorithm
- fuzzy systems
- associative memory
- recurrent neural networks
- feed forward
- back propagation
- computational intelligence
- image processing
- biologically inspired
- decision trees
- self organizing maps
- fault diagnosis
- loss function
- competitive learning
- temporal evolution
- expert systems