An Information Theoretic Interpretation to Deep Neural Networks.
Shao-Lun HuangXiangxiang XuLizhong ZhengGregory W. WornellPublished in: ISIT (2019)
Keyphrases
- information theoretic
- neural network
- competitive learning
- information theory
- mutual information
- theoretic framework
- information bottleneck
- pattern recognition
- information theoretic measures
- jensen shannon divergence
- multi modality
- log likelihood
- image processing
- computational learning theory
- entropy measure
- image registration
- computer vision
- bregman divergences
- relative entropy
- data mining
- multi class
- minimum description length
- machine learning