A Comprehensive Survey and Performance Analysis of Activation Functions in Deep Learning.
Shiv Ram DubeySatish Kumar SinghBidyut Baran ChaudhuriPublished in: CoRR (2021)
Keyphrases
- deep learning
- activation function
- neural network
- feed forward
- artificial neural networks
- unsupervised learning
- hidden layer
- back propagation
- machine learning
- learning rate
- basis functions
- neural nets
- network architecture
- radial basis function
- multilayer perceptron
- weakly supervised
- mental models
- artificial intelligence
- rbf neural network
- training phase
- object recognition
- fuzzy neural network
- learning algorithm
- fuzzy logic
- multi layer perceptron
- support vector
- latent variables
- expert systems
- pairwise
- expectation maximization