Pipelined Backpropagation at Scale: Training Large Models without Batches.
Atli KossonVitaliy ChileyAbhinav VenigallaJoel HestnessUrs KösterPublished in: CoRR (2020)
Keyphrases
- back propagation
- training algorithm
- neural network
- artificial neural networks
- feed forward neural networks
- feed forward
- feedforward neural networks
- neural nets
- backpropagation algorithm
- probabilistic model
- multilayer perceptron neural network
- learning algorithm
- linear regression
- neural network model
- bp algorithm
- supervised learning
- backpropagation neural networks
- least squares