Entropy and mutual information in models of deep neural networks.
Marylou GabriéAndre ManoelClément LuneauJean BarbierNicolas MacrisFlorent KrzakalaLenka ZdeborováPublished in: CoRR (2018)
Keyphrases
- mutual information
- neural network
- information theoretic
- similarity measure
- neural nets
- information gain
- image registration
- statistical models
- probabilistic model
- conditional entropy
- complex systems
- shannon entropy
- bayesian networks
- neural network model
- information theoretic measures
- hybrid models
- data sets
- experimental data
- statistical model
- self organizing maps
- multiresolution
- pattern recognition
- training data