An Information Theoretic Tradeoff between Complexity and Accuracy.
Ran Gilad-BachrachAmir NavotNaftali TishbyPublished in: COLT (2003)
Keyphrases
- information theoretic
- mutual information
- information theory
- computational complexity
- theoretic framework
- information bottleneck
- jensen shannon divergence
- information theoretic measures
- multi modality
- log likelihood
- relative entropy
- worst case
- minimum description length
- distributional clustering
- computer vision
- computational learning theory
- kl divergence
- pattern recognition