Exactly Tight Information-Theoretic Generalization Error Bound for the Quadratic Gaussian Problem.
Ruida ZhouChao TianTie LiuPublished in: IEEE J. Sel. Areas Inf. Theory (2024)
Keyphrases
- information theoretic
- error bounds
- worst case
- mutual information
- information theory
- theoretic framework
- lower bound
- upper bound
- theoretical analysis
- information bottleneck
- jensen shannon divergence
- log likelihood
- objective function
- kullback leibler divergence
- pairwise
- maximum likelihood
- computational complexity
- information theoretic measures
- distributional clustering
- entropy measure
- parzen window
- gaussian mixture
- training error
- bregman divergences
- minimum description length
- gaussian distribution
- image registration