Bottlenecks CLUB: Unifying Information-Theoretic Trade-offs Among Complexity, Leakage, and Utility.
Behrooz RazeghiFlávio P. CalmonDeniz GündüzSlava VoloshynovskiyPublished in: CoRR (2022)
Keyphrases
- information theoretic
- trade off
- information theory
- mutual information
- theoretic framework
- information theoretic measures
- jensen shannon divergence
- log likelihood
- information bottleneck
- entropy measure
- minimum description length
- relative entropy
- utility function
- multi modality
- jensen shannon
- kullback leibler divergence
- computational learning theory
- em algorithm
- text classification
- image classification
- graphical models
- similarity measure
- image processing
- machine learning