Individually Conditional Individual Mutual Information Bound on Generalization Error.
Ruida ZhouChao TianTie LiuPublished in: ISIT (2021)
Keyphrases
- generalization error
- mutual information
- upper bound
- generalization error bounds
- rademacher complexity
- training error
- cross validation
- uniform convergence
- model selection
- active learning
- classification error
- sample complexity
- sample size
- binary classification
- training set
- linear classifiers
- image registration
- training data
- learning algorithm
- similarity measure
- lower bound
- supervised learning
- target function
- training set size
- risk minimization
- conditional expectation
- vc dimension
- perceptron learning
- subspace information criterion
- data dependent
- worst case
- decision trees
- expected error
- learning machines
- concept classes
- boosting algorithms
- minimum margin
- feature selection