Information-Theoretic Bounds on the Moments of the Generalization Error of Learning Algorithms.
Gholamali AminianLaura ToniMiguel R. D. RodriguesPublished in: CoRR (2021)
Keyphrases
- information theoretic
- generalization error
- learning algorithm
- upper bound
- algorithmic stability
- generalization error bounds
- training error
- uniform convergence
- sample complexity
- information theory
- mutual information
- learning machines
- active learning
- lower bound
- binary classification
- model selection
- cross validation
- linear classifiers
- vc dimension
- training data
- information bottleneck
- sample size
- training set
- target function
- supervised learning
- information theoretic measures
- worst case
- boosting algorithms
- generalization bounds
- learning rate
- neural network
- reinforcement learning
- labeled data
- learning problems
- training samples
- feature selection
- objective function
- unbiased estimator
- similarity measure