Information Theoretic Lower Bounds on Negative Log Likelihood.
Luis A. LastrasPublished in: CoRR (2019)
Keyphrases
- information theoretic
- lower bound
- upper bound
- mutual information
- information theory
- theoretic framework
- information bottleneck
- objective function
- log likelihood
- information theoretic measures
- vc dimension
- multi modality
- jensen shannon divergence
- entropy measure
- jensen shannon
- worst case
- optimal solution
- minimum description length
- computational learning theory
- kl divergence
- image registration