On Palimpsests in Neural Memory: An Information Theory Viewpoint.
Lav R. VarshneyJulius KusumaVivek K. GoyalPublished in: IEEE Trans. Mol. Biol. Multi Scale Commun. (2016)
Keyphrases
- information theory
- viewpoint
- information theoretic
- associative memory
- jensen shannon divergence
- statistical learning
- statistical mechanics
- network architecture
- conditional entropy
- neural network
- memory requirements
- statistical physics
- kullback leibler divergence
- relative entropy
- mutual information
- shannon entropy
- information geometry
- pattern recognition