A Unifying Variational Perspective on Some Fundamental Information Theoretic Inequalities
Sangwoo ParkErchin SerpedinKhalid A. QaraqePublished in: CoRR (2012)
Keyphrases
- information theoretic
- mutual information
- information theory
- theoretic framework
- log likelihood
- jensen shannon divergence
- information bottleneck
- competitive learning
- information theoretic measures
- minimum description length
- kullback leibler divergence
- distributional clustering
- sufficient conditions
- image segmentation
- multi modality
- computational learning theory
- entropy measure
- kl divergence
- relative entropy
- computer vision
- learning theory
- objective function
- image processing