Phase diagram of Stochastic Gradient Descent in high-dimensional two-layer neural networks.
Rodrigo VeigaLudovic StephanBruno LoureiroFlorent KrzakalaLenka ZdeborováPublished in: CoRR (2022)
Keyphrases
- machine learning
- stochastic gradient descent
- high dimensional
- neural network
- support vector machine
- matrix factorization
- least squares
- loss function
- step size
- random forests
- nearest neighbor
- learning algorithm
- weight vector
- regularization parameter
- low dimensional
- data points
- back propagation
- missing data
- importance sampling
- high dimensional data
- parameter space
- knn
- cost function
- feature space
- support vector
- feature selection