Improving the Trainability of Deep Neural Networks through Layerwise Batch-Entropy Regularization.
David PeerBart KeulenSebastian StabingerJustus H. PiaterAntonio Jose Rodríguez-SánchezPublished in: CoRR (2022)
Keyphrases
- neural network
- mutual information
- fuzzy logic
- information theory
- multi layer
- fuzzy systems
- feed forward
- neural network model
- hidden layer
- fault diagnosis
- back propagation
- artificial neural networks
- expert systems
- cellular neural networks
- activation function
- information entropy
- deep learning
- batch processing
- radial basis function
- recurrent neural networks
- multilayer perceptron
- information theoretic
- lower bound
- pattern recognition
- image processing
- genetic algorithm
- machine learning