Examining the Causal Structures of Deep Neural Networks Using Information Theory.
Scythia MarrowEric J. MichaudErik HoelPublished in: Entropy (2020)
Keyphrases
- information theory
- neural network
- information theoretic
- statistical learning
- jensen shannon divergence
- statistical mechanics
- conditional entropy
- pattern recognition
- kullback leibler divergence
- relative entropy
- bayesian networks
- causal relationships
- statistical physics
- artificial neural networks
- mdl principle
- shannon entropy