Kolmogorov Complexity in perspective. Part I: Information Theory and Randomnes
Marie Ferbus-ZandaSerge GrigorieffPublished in: CoRR (2010)
Keyphrases
- information theory
- kolmogorov complexity
- information theoretic
- inductive inference
- statistical mechanics
- jensen shannon divergence
- statistical learning
- conditional entropy
- complexity measures
- statistical physics
- relative entropy
- kullback leibler divergence
- rate distortion theory
- learning algorithm
- mdl principle
- information geometry
- training data