Searching for Activation Functions.
Prajit RamachandranBarret ZophQuoc V. LePublished in: CoRR (2017)
Keyphrases
- activation function
- neural network
- neural architecture
- feed forward
- back propagation
- feed forward neural networks
- artificial neural networks
- hidden layer
- learning rate
- complex valued
- neural nets
- multilayer perceptron
- radial basis function
- network architecture
- basis functions
- learning algorithm
- linear combination
- hidden nodes
- continuous functions
- machine learning
- training phase
- recurrent neural networks
- bayesian networks
- neural network model
- learning tasks
- fuzzy logic
- probabilistic model