Understanding Individual Neuron Importance Using Information Theory.

Kairen Liu Rana Ali Amjad Bernhard C. Geiger

Published in: CoRR (2018)

Keyphrases

information theory
information theoretic
statistical mechanics
statistical learning
jensen shannon divergence
kullback leibler divergence
conditional entropy
neural network
statistical physics
shannon entropy
mdl principle
relative entropy
rate distortion theory
similarity measure
information geometry