A survey on recently proposed activation functions for Deep Learning.
Murilo GustineliPublished in: CoRR (2022)
Keyphrases
- deep learning
- activation function
- neural network
- artificial neural networks
- unsupervised learning
- feed forward
- network architecture
- neural nets
- mental models
- hidden layer
- back propagation
- machine learning
- basis functions
- learning rate
- multilayer perceptron
- weakly supervised
- radial basis function
- text classification
- dimensionality reduction
- higher order
- prior knowledge
- computer vision