Activation Functions: Dive into an optimal activation function.
Vipul BansalPublished in: CoRR (2022)
Keyphrases
- activation function
- neural network
- feed forward
- artificial neural networks
- hidden layer
- back propagation
- neural nets
- feed forward neural networks
- multilayer perceptron
- network size
- radial basis function
- basis functions
- learning rate
- connection weights
- neural architecture
- feedforward neural networks
- network architecture
- hidden neurons
- hidden nodes
- multi layer perceptron
- genetic algorithm
- training phase
- fuzzy neural network
- rbf neural network
- fuzzy rules
- dynamic programming
- learning algorithm
- sigmoid function