Numerical influence of ReLU'(0) on backpropagation.
David BertoinJérôme BolteSébastien GerchinovitzEdouard PauwelsPublished in: NeurIPS (2021)
Keyphrases
- back propagation
- artificial neural networks
- neural network
- feed forward
- bp algorithm
- training algorithm
- bp neural network
- fuzzy logic
- multilayer perceptron
- feedforward neural networks
- learning algorithm
- levenberg marquardt
- hidden layer
- multilayer perceptron neural network
- neural nets
- feed forward neural networks
- backpropagation neural networks
- activation function
- cascade correlation
- backpropagation neural network
- trained neural network
- connection weights
- backpropagation algorithm
- neural network ensemble
- control system
- convergence speed
- error back propagation
- multilayer neural network
- data mining
- real time
- artificial intelligence
- recurrent neural networks