Bounding generalization error with input compression: An empirical study with infinite-width networks.
Angus GallowayAnna GolubevaMahmoud SalemMihai NicaYani A. IoannouGraham W. TaylorPublished in: Trans. Mach. Learn. Res. (2023)
Keyphrases
- generalization error
- upper bound
- cross validation
- classification error
- model selection
- learning algorithm
- active learning
- sample complexity
- linear classifiers
- binary classification
- training set
- sample size
- training error
- training data
- generalization error bounds
- lower bound
- perceptron learning
- learning machines
- supervised learning
- target function
- compression algorithm
- image compression
- conditional expectation
- training set size
- compression scheme
- compression ratio
- data sets
- low error
- unbiased estimator
- subspace information criterion
- boosting algorithms
- data compression
- worst case
- optimal solution
- reinforcement learning