An Information Theoretic Interpretation to Deep Neural Networks.
Shao-Lun HuangXiangxiang XuLizhong ZhengGregory W. WornellPublished in: CoRR (2019)
Keyphrases
- information theoretic
- neural network
- competitive learning
- information theory
- mutual information
- theoretic framework
- information theoretic measures
- log likelihood
- pattern recognition
- jensen shannon divergence
- entropy measure
- relative entropy
- kullback leibler divergence
- minimum description length
- information bottleneck
- multi modality
- machine learning