Why RELU Units Sometimes Die: Analysis of Single-Unit Error Backpropagation in Neural Networks.
Scott C. DouglasJiutian YuPublished in: ACSSC (2018)
Keyphrases
- back propagation
- neural network
- artificial neural networks
- feed forward
- multilayer perceptron
- neural nets
- training algorithm
- activation function
- feedforward neural networks
- bp neural network
- learning algorithm
- backpropagation algorithm
- bp algorithm
- fuzzy logic
- learning rules
- feed forward neural networks
- connection weights
- trained neural network
- backpropagation neural network
- backpropagation neural networks
- cascade correlation
- hidden layer
- prediction model
- simulated annealing
- multilayer perceptron neural network