Information Theoretic Lower Bounds for Information Theoretic Upper Bounds.
Roi LivniPublished in: NeurIPS (2023)
Keyphrases
- information theoretic
- upper bound
- lower bound
- information theory
- mutual information
- theoretic framework
- information bottleneck
- upper and lower bounds
- lower and upper bounds
- jensen shannon divergence
- worst case
- bregman divergences
- log likelihood
- kullback leibler divergence
- relative entropy
- minimum description length
- objective function
- sample size
- computational learning theory
- distributional clustering
- multi modality
- sample complexity
- generalization error
- optimal cost
- entropy measure
- feature selection
- information theoretic measures