Activation functions in deep learning: A comprehensive survey and benchmark.
Shiv Ram DubeySatish Kumar SinghBidyut Baran ChaudhuriPublished in: Neurocomputing (2022)
Keyphrases
- deep learning
- activation function
- neural network
- artificial neural networks
- unsupervised learning
- machine learning
- back propagation
- hidden layer
- learning rate
- feed forward
- neural nets
- radial basis function
- multilayer perceptron
- mental models
- network architecture
- weakly supervised
- fuzzy neural network
- multi layer perceptron
- high dimensional
- training phase
- rbf neural network
- basis functions
- learning algorithm
- genetic algorithm