Some Observations on the Concepts of Information-Theoretic Entropy and Randomness.
Jonathan D. H. SmithPublished in: Entropy (2001)
Keyphrases
- information theoretic
- information theory
- mutual information
- theoretic framework
- information bottleneck
- entropy measure
- relative entropy
- information theoretic measures
- kullback leibler divergence
- minimum description length
- jensen shannon divergence
- log likelihood
- multi modality
- computational learning theory
- shannon entropy
- feature selection
- similarity measure
- background knowledge
- mixture model
- bayesian networks