Evolution of Activation Functions: An Empirical Investigation.
Andrew NaderDanielle AzarPublished in: ACM Trans. Evol. Learn. Optim. (2021)
Keyphrases
- activation function
- neural network
- artificial neural networks
- neural architecture
- feed forward
- complex valued
- feed forward neural networks
- back propagation
- hidden layer
- neural nets
- radial basis function
- learning rate
- basis functions
- network architecture
- hidden nodes
- training phase
- multilayer perceptron
- fuzzy neural network
- input space
- recurrent neural networks
- multi layer perceptron
- continuous functions
- probabilistic model