Learning Curves for Stochastic Gradient Descent in Linear Feedforward Networks.
Justin WerfelXiaohui XieH. Sebastian SeungPublished in: Neural Comput. (2005)
Keyphrases
- feed forward
- learning curves
- stochastic gradient descent
- power law
- learning curve
- back propagation
- weight vector
- average case
- artificial neural networks
- matrix factorization
- neural network
- least squares
- random graphs
- random forests
- step size
- loss function
- learning algorithm
- support vector machine
- gaussian processes
- upper bound
- vc dimension
- linear model
- closed form
- worst case
- wavelet transform
- multiscale
- learning tasks
- sample size