An Information Theoretic Interpretation to Deep Neural Networks.
Xiangxiang XuShao-Lun HuangLizhong ZhengGregory W. WornellPublished in: Entropy (2022)
Keyphrases
- information theoretic
- neural network
- competitive learning
- information theory
- mutual information
- theoretic framework
- pattern recognition
- information bottleneck
- jensen shannon divergence
- kullback leibler divergence
- information theoretic measures
- multi modality
- log likelihood
- relative entropy
- computational learning theory
- minimum description length
- entropy measure
- image intensity
- medical images
- machine learning