Information-Theoretic Self-compression of Multi-layered Neural Networks.
Ryotaro KamimuraPublished in: TPNC (2018)
Keyphrases
- information theoretic
- multi layered
- neural learning
- neural network
- information theory
- competitive learning
- mutual information
- theoretic framework
- information bottleneck
- jensen shannon divergence
- entropy measure
- minimum description length
- kullback leibler divergence
- information theoretic measures
- log likelihood
- multi modality
- self organizing maps
- pattern recognition
- kl divergence
- image registration
- wavelet transform
- learning algorithm