Understanding Convolutional Neural Networks With Information Theory: An Initial Exploration.
Shujian YuKristoffer WickstrømRobert JenssenJosé C. PríncipePublished in: IEEE Trans. Neural Networks Learn. Syst. (2021)
Keyphrases
- information theory
- convolutional neural networks
- information theoretic
- statistical learning
- jensen shannon divergence
- conditional entropy
- statistical mechanics
- kullback leibler divergence
- statistical physics
- convolutional network
- mdl principle
- shannon entropy
- information geometry
- rate distortion theory
- data mining
- relative entropy
- mutual information
- computer vision