Three Decades of Activations: A Comprehensive Survey of 400 Activation Functions for Neural Networks.
Vladimír KuncJirí KlémaPublished in: CoRR (2024)
Keyphrases
- activation function
- neural network
- feed forward
- back propagation
- artificial neural networks
- feed forward neural networks
- hidden layer
- neural nets
- connection weights
- hidden neurons
- feedforward neural networks
- network architecture
- learning rate
- multilayer perceptron
- hidden nodes
- neural architecture
- pattern recognition
- recurrent neural networks
- knn
- multi layer
- neural network model
- radial basis function
- basis functions
- fuzzy neural network
- training phase
- multi layer perceptron
- high dimensional
- genetic algorithm
- fault diagnosis
- expert systems
- decision making
- artificial intelligence