An information-theoretic lower bound in time-uniform estimation.
John C. DuchiSaminul HaquePublished in: CoRR (2024)
Keyphrases
- information theoretic
- lower bound
- information theory
- mutual information
- upper bound
- theoretic framework
- information bottleneck
- log likelihood
- information theoretic measures
- jensen shannon divergence
- multi modality
- kullback leibler divergence
- entropy measure
- computational learning theory
- objective function
- kl divergence
- parameter estimation
- optimal solution
- sample complexity
- worst case
- minimum description length
- relative entropy
- pattern recognition
- probabilistic model
- similarity measure
- distributional clustering