Optimizing Neural Networks through Activation Function Discovery and Automatic Weight Initialization.
Garrett BinghamPublished in: CoRR (2023)
Keyphrases
- activation function
- neural network
- hidden nodes
- artificial neural networks
- hidden layer
- feed forward
- back propagation
- feed forward neural networks
- multilayer perceptron
- feedforward neural networks
- single hidden layer
- neural nets
- hidden neurons
- network architecture
- backpropagation algorithm
- learning rate
- radial basis function
- basis functions
- chaotic neural network
- neural network model
- sigmoid function
- single layer
- pattern recognition
- extreme learning machine
- multi layer perceptron
- rbf neural network
- supervised learning