Review and Comparison of Commonly Used Activation Functions for Deep Neural Networks.
Tomasz SzandalaPublished in: CoRR (2020)
Keyphrases
- activation function
- neural network
- feed forward
- artificial neural networks
- back propagation
- feed forward neural networks
- hidden layer
- neural nets
- neural architecture
- hidden neurons
- multilayer perceptron
- hidden nodes
- learning rate
- feedforward neural networks
- connection weights
- network architecture
- fuzzy neural network
- recurrent neural networks
- pattern recognition
- multi layer
- rbf neural network
- fuzzy logic
- control system
- machine learning