Strengthened Information-theoretic Bounds on the Generalization Error.
Ibrahim IssaAmedeo Roberto EspositoMichael GastparPublished in: ISIT (2019)
Keyphrases
- information theoretic
- generalization error
- upper bound
- generalization error bounds
- training error
- uniform convergence
- mutual information
- information theory
- lower bound
- cross validation
- model selection
- classification error
- learning machines
- binary classification
- active learning
- sample complexity
- linear classifiers
- theoretic framework
- learning algorithm
- jensen shannon divergence
- training data
- worst case
- training set
- sample size
- information theoretic measures
- information bottleneck
- supervised learning
- target function
- generalization bounds
- vc dimension
- data sets
- feature space
- jensen shannon
- pairwise
- special case
- probabilistic model
- error rate