A Theory of Program Size Formally Identical to Information Theory.

Gregory J. Chaitin

Published in: J. ACM (1975)

Keyphrases

information theory
information theoretic
statistical learning
statistical physics
jensen shannon divergence
statistical mechanics
kullback leibler divergence
mdl principle
shannon entropy
machine learning
relative entropy
conditional entropy
information geometry
mutual information