Deeper Neural Networks with Non-Vanishing Logistic Hidden Units: NoVa vs. ReLU Neurons.
Olaoluwa AdigunBart KoskoPublished in: ICMLA (2021)
Keyphrases
- hidden units
- neural network
- hidden layer
- activation function
- feed forward neural networks
- back propagation
- rbf network
- feed forward
- multilayer perceptron
- radial basis function
- nonlinear functions
- artificial neural networks
- learning rate
- pattern recognition
- recurrent neural networks
- neural nets
- rbf neural network
- fuzzy neural network
- multi layer perceptron
- fault diagnosis
- fuzzy systems
- fuzzy logic
- number of hidden units
- training algorithm
- neural network model
- network architecture
- training phase
- bp neural network
- basis functions
- input output
- learning algorithm
- output layer
- genetic algorithm