Sharpened Generalization Bounds based on Conditional Mutual Information and an Application to Noisy, Iterative Algorithms.
Mahdi HaghifamJeffrey NegreaAshish KhistiDaniel M. RoyGintare Karolina DziugaitePublished in: NeurIPS (2020)
Keyphrases
- iterative algorithms
- generalization bounds
- conditional mutual information
- mutual information
- data dependent
- learning theory
- model selection
- generalization ability
- selection criterion
- ranking algorithm
- statistical learning theory
- linear classifiers
- learning problems
- vc dimension
- learning algorithm
- statistical learning
- learning machines
- ranking functions
- upper bound
- support vector machine
- support vector
- machine learning
- multi class
- kernel machines
- decision trees
- similarity measure
- generalization error
- feature space
- active learning
- data sets
- cross validation
- sample size