A Formal Characterization of Activation Functions in Deep Neural Networks.
Massi AmroucheDusan M. StipanovicPublished in: IEEE Trans. Neural Networks Learn. Syst. (2024)
Keyphrases
- activation function
- neural network
- artificial neural networks
- feed forward
- hidden layer
- back propagation
- feed forward neural networks
- connection weights
- neural nets
- neural architecture
- learning rate
- multilayer perceptron
- hidden neurons
- basis functions
- feedforward neural networks
- fuzzy neural network
- radial basis function
- network architecture
- recurrent neural networks
- neural network model
- pattern recognition
- small number
- fuzzy logic
- hidden nodes
- evolutionary algorithm
- bp neural network
- multi layer perceptron
- state space
- probabilistic model