Counting distinctions: on the conceptual foundations of Shannon's information theory.

David P. Ellerman

Published in: Synth. (2009)

Keyphrases

information theory
information theoretic
jensen shannon divergence
statistical learning
statistical mechanics
artificial intelligence
conditional entropy
kullback leibler divergence
computer vision
shannon entropy
relative entropy
information geometry
mutual information
video coding
mdl principle