Tightening Mutual Information-Based Bounds on Generalization Error.
Yuheng BuShaofeng ZouVenugopal V. VeeravalliPublished in: IEEE J. Sel. Areas Inf. Theory (2020)
Keyphrases
- generalization error
- upper bound
- generalization error bounds
- training error
- lower bound
- rademacher complexity
- uniform convergence
- algorithmic stability
- cross validation
- sample complexity
- learning machines
- binary classification
- model selection
- training set
- learning algorithm
- active learning
- linear classifiers
- vc dimension
- classification error
- training data
- sample size
- supervised learning
- target function
- worst case
- boosting algorithms
- perceptron learning
- risk minimization
- conditional expectation
- subspace information criterion
- machine learning
- support vector
- artificial neural networks
- expected error
- learning process
- np hard
- error bounds