Optimization and Generalization of Shallow Neural Networks with Quadratic Activation Functions.
Stefano Sarao MannelliEric Vanden-EijndenLenka ZdeborováPublished in: CoRR (2020)
Keyphrases
- activation function
- neural network
- feed forward
- artificial neural networks
- hidden layer
- feed forward neural networks
- back propagation
- neural architecture
- neural nets
- hidden neurons
- connection weights
- multilayer perceptron
- feedforward neural networks
- learning rate
- network architecture
- radial basis function
- optimization algorithm
- global optimization
- pattern recognition
- genetic algorithm
- recurrent neural networks
- basis functions
- multi layer perceptron
- hidden nodes
- fuzzy logic
- objective function
- optimization method
- training phase
- feature selection