A Unifying Variational Perspective on Some Fundamental Information Theoretic Inequalities.
Sangwoo ParkErchin SerpedinKhalid A. QaraqePublished in: IEEE Trans. Inf. Theory (2013)
Keyphrases
- information theoretic
- information theory
- mutual information
- theoretic framework
- jensen shannon divergence
- information theoretic measures
- log likelihood
- information bottleneck
- competitive learning
- multi modality
- minimum description length
- sufficient conditions
- kullback leibler divergence
- relative entropy
- data mining
- entropy measure
- image segmentation
- multi modal
- variational methods
- bregman divergences
- machine learning
- similarity measure
- computational learning theory
- computer vision