Generalization error in high-dimensional perceptrons: Approaching Bayes error with convex optimization.
Benjamin AubinFlorent KrzakalaYue M. LuLenka ZdeborováPublished in: CoRR (2020)
Keyphrases
- convex optimization
- generalization error
- bayes error
- high dimensional
- cross validation
- linear classifiers
- upper bound
- active learning
- model selection
- learning algorithm
- training data
- training set
- binary classification
- k nearest neighbor
- class distribution
- sample size
- nearest neighbor
- supervised learning
- variable selection
- total variation
- data points
- high dimensional data
- knn
- learning tasks
- lower bound
- feature space
- training samples
- data sets
- boosting algorithms
- test set
- cost sensitive
- denoising
- wavelet transform
- computer vision
- dimensionality reduction