Evolution of Activation Functions: An Empirical Investigation.
Andrew NaderDanielle AzarPublished in: CoRR (2021)
Keyphrases
- activation function
- neural network
- artificial neural networks
- neural architecture
- hidden layer
- feed forward neural networks
- back propagation
- complex valued
- feed forward
- neural nets
- multilayer perceptron
- basis functions
- fuzzy neural network
- learning rate
- training phase
- fuzzy logic
- input space
- radial basis function
- network architecture
- small number
- prior knowledge
- hidden nodes
- evolutionary algorithm