Understanding generalization error of SGD in nonconvex optimization.
Yi ZhouYingbin LiangHuishuai ZhangPublished in: Mach. Learn. (2022)
Keyphrases
- generalization error
- risk minimization
- global optimization
- optimization problems
- cross validation
- model selection
- active learning
- upper bound
- classification error
- training error
- training data
- sample complexity
- learning algorithm
- linear classifiers
- training set
- binary classification
- supervised learning
- stochastic gradient descent
- sample size
- subspace information criterion
- target function
- generalization error bounds
- evolutionary algorithm
- boosting algorithms
- lower bound
- conditional expectation
- data sets
- loss function
- prediction accuracy
- pairwise
- machine learning