Searching for Activation Functions.
Prajit RamachandranBarret ZophQuoc V. LePublished in: ICLR (Workshop) (2018)
Keyphrases
- activation function
- neural network
- complex valued
- neural architecture
- artificial neural networks
- feed forward neural networks
- feed forward
- hidden layer
- neural nets
- learning rate
- network architecture
- back propagation
- multilayer perceptron
- basis functions
- radial basis function
- continuous functions
- hidden nodes
- fuzzy neural network
- training phase
- feature selection
- hardware implementation