The nomenclature of information theory.

Donald M. MacKay

Published in: Trans. IRE Prof. Group Inf. Theory (1953)

Keyphrases

information theory
information theoretic
jensen shannon divergence
statistical mechanics
statistical learning
conditional entropy
shannon entropy
kullback leibler divergence
pattern recognition
mutual information
relative entropy
statistical physics