Why ReLU Units Sometimes Die: Analysis of Single-Unit Error Backpropagation in Neural Networks.
Scott C. DouglasJiutian YuPublished in: CoRR (2018)
Keyphrases
- back propagation
- neural network
- artificial neural networks
- feed forward
- multilayer perceptron
- feed forward neural networks
- neural nets
- feedforward neural networks
- hidden layer
- backpropagation neural networks
- bp algorithm
- learning algorithm
- trained neural network
- backpropagation neural network
- training algorithm
- multi layer
- neural network ensemble
- error back propagation
- levenberg marquardt
- backpropagation algorithm
- rbf network
- activation function
- bp neural network
- genetic algorithm