Exactly Tight Information-Theoretic Generalization Error Bound for the Quadratic Gaussian Problem.
Ruida ZhouChao TianTie LiuPublished in: ISIT (2023)
Keyphrases
- information theoretic
- error bounds
- worst case
- mutual information
- information theory
- theoretical analysis
- theoretic framework
- upper bound
- computational complexity
- lower bound
- log likelihood
- jensen shannon divergence
- entropy measure
- kullback leibler divergence
- information bottleneck
- maximum likelihood
- pairwise
- information theoretic measures
- training error
- objective function
- minimum description length
- bregman divergences
- distributional clustering
- sample size
- optimal solution