Counting Distinctions: On the Conceptual Foundations of Shannon's Information Theory

David P. Ellerman

Published in: CoRR (2009)

Keyphrases

information theory
information theoretic
statistical mechanics
jensen shannon divergence
statistical learning
conditional entropy
kullback leibler divergence
artificial intelligence
shannon entropy
mutual information
data mining
mdl principle