Bounding generalization error with input compression: An empirical study with infinite-width networks.
Angus GallowayAnna GolubevaMahmoud SalemMihai NicaYani A. IoannouGraham W. TaylorPublished in: CoRR (2022)
Keyphrases
- generalization error
- upper bound
- cross validation
- model selection
- learning algorithm
- active learning
- classification error
- binary classification
- sample complexity
- target function
- linear classifiers
- training set
- sample size
- training data
- perceptron learning
- training error
- supervised learning
- lower bound
- compression algorithm
- compression scheme
- generalization error bounds
- low error
- subspace information criterion
- learning machines
- image compression
- data compression
- input parameters
- boosting algorithms
- optimal solution
- compression ratio
- theoretical analysis