The Dynamics of Gradient Descent for Overparametrized Neural Networks.
Siddhartha SatpathiRayadurgam SrikantPublished in: L4DC (2021)
Keyphrases
- neural network
- learning rules
- recurrent networks
- pattern recognition
- artificial neural networks
- cost function
- nonlinear dynamics
- fuzzy logic
- self organizing maps
- genetic algorithm
- network architecture
- neural nets
- dynamic model
- objective function
- neural network model
- multi layer
- loss function
- feed forward
- back propagation
- computational intelligence
- fuzzy systems
- training process
- evolutionary algorithm
- fuzzy neural network
- activation function
- artificial intelligence
- image processing
- conjugate gradient
- highly nonlinear
- real time