The information theory of developmental pruning: Optimizing global network architectures using local synaptic rules.
Carolin SchollMichael Everett RuleMatthias H. HennigPublished in: PLoS Comput. Biol. (2021)
Keyphrases
- information theory
- information theoretic
- jensen shannon divergence
- statistical mechanics
- learning rules
- conditional entropy
- association rules
- statistical learning
- statistical physics
- mutual information
- search space
- rate distortion theory
- shannon entropy
- feed forward
- relative entropy
- pruning strategy
- effective pruning