Towards Generalizing the Information Theory for Neural Communication.
János VéghÁdám József BerkiPublished in: Entropy (2022)
Keyphrases
- information theory
- information theoretic
- jensen shannon divergence
- statistical learning
- statistical mechanics
- kullback leibler divergence
- conditional entropy
- neural network
- statistical physics
- network architecture
- relative entropy
- communication systems
- information geometry
- image processing
- mdl principle
- associative memory
- multi agent systems
- video coding
- mutual information