Information Theory and Statistics: A Tutorial.

Imre Csiszár Paul C. Shields

Published in: Found. Trends Commun. Inf. Theory (2004)

Keyphrases

information theory
information theoretic
jensen shannon divergence
statistical mechanics
statistical learning
conditional entropy
machine learning
statistical physics
mutual information
kullback leibler divergence
shannon entropy
mdl principle
relative entropy
information geometry
rate distortion theory