Individually Conditional Individual Mutual Information Bound on Generalization Error.
Ruida ZhouChao TianTie LiuPublished in: IEEE Trans. Inf. Theory (2022)
Keyphrases
- generalization error
- mutual information
- upper bound
- generalization error bounds
- rademacher complexity
- training error
- uniform convergence
- cross validation
- learning algorithm
- model selection
- classification error
- linear classifiers
- active learning
- lower bound
- sample complexity
- binary classification
- supervised learning
- training data
- target function
- training set
- training set size
- image registration
- worst case
- subspace information criterion
- sample size
- vc dimension
- risk minimization
- perceptron learning
- neural network
- learning machines
- generalization bounds
- similarity measure
- feature selection
- convergence rate
- conditional expectation
- multi class
- machine learning