Information-Theoretic Characterizations of Generalization Error for the Gibbs Algorithm.
Gholamali AminianYuheng BuLaura ToniMiguel R. D. RodriguesGregory W. WornellPublished in: IEEE Trans. Inf. Theory (2024)
Keyphrases
- information theoretic
- learning algorithm
- generalization error
- information bottleneck
- log likelihood
- optimal solution
- entropy measure
- worst case
- relative entropy
- information theoretic measures
- mutual information
- objective function
- theoretic framework
- data mining
- computational complexity
- convergence rate
- bayesian framework
- active learning
- similarity measure