On Linear Stability of SGD and Input-Smoothness of Neural Networks.
Chao MaLexing YingPublished in: NeurIPS (2021)
Keyphrases
- neural network
- desired output
- nonlinear functions
- input data
- pattern recognition
- highly non linear
- genetic algorithm
- hidden units
- stability analysis
- fuzzy systems
- multi layer
- artificial neural networks
- self organizing maps
- radial basis function
- feed forward
- multilayer perceptron
- back propagation
- least squares
- hidden layer
- cost function
- optical flow
- stochastic gradient descent
- lyapunov function
- lower bound
- learning algorithm