High-dimensional dynamics of generalization error in neural networks.
Madhu S. AdvaniAndrew M. SaxeHaim SompolinskyPublished in: Neural Networks (2020)
Keyphrases
- generalization error
- high dimensional
- neural network
- cross validation
- model selection
- learning algorithm
- active learning
- classification error
- upper bound
- variable selection
- training set
- sample complexity
- linear classifiers
- training error
- training data
- binary classification
- generalization error bounds
- sample size
- supervised learning
- target function
- artificial neural networks
- fuzzy logic
- low dimensional
- genetic algorithm
- neural network model
- multilayer perceptron
- subspace information criterion
- perceptron learning
- conditional expectation
- dimensionality reduction
- back propagation
- feature space
- training process
- training algorithm
- neural nets
- parameter space
- hidden layer
- fault diagnosis
- feed forward
- boosting algorithms
- data points
- support vector
- recurrent neural networks
- real valued