An information-theoretic lower bound in time-uniform estimation.
John C. DuchiSaminul HaquePublished in: COLT (2024)
Keyphrases
- information theoretic
- lower bound
- mutual information
- information theory
- upper bound
- theoretic framework
- information bottleneck
- information theoretic measures
- minimum description length
- kullback leibler divergence
- log likelihood
- jensen shannon divergence
- objective function
- worst case
- optimal solution
- relative entropy
- jensen shannon
- learning algorithm
- entropy measure
- image classification
- image processing
- computer vision