Discovering Parametric Activation Functions.
Garrett BinghamRisto MiikkulainenPublished in: CoRR (2020)
Keyphrases
- activation function
- neural network
- artificial neural networks
- feed forward
- feed forward neural networks
- hidden layer
- back propagation
- complex valued
- parametric models
- neural architecture
- neural nets
- radial basis function
- hidden nodes
- learning rate
- multilayer perceptron
- network architecture
- basis functions
- training phase
- fuzzy neural network
- rbf neural network
- fuzzy logic
- artificial intelligence
- linear combination
- small number
- knn
- prior knowledge
- expert systems
- pattern recognition