Training Distributed Deep Recurrent Neural Networks with Mixed Precision on GPU Clusters.
Alexey SvyatkovskiyJulian Kates-HarbeckWilliam TangPublished in: CoRR (2019)
Keyphrases
- recurrent neural networks
- recurrent networks
- echo state networks
- feedforward neural networks
- neural network
- feed forward
- reservoir computing
- distributed systems
- clustering algorithm
- complex valued
- long short term memory
- neural model
- feed forward neural networks
- hierarchical clustering
- artificial neural networks
- training algorithm
- real time
- hidden layer
- multi agent
- cluster analysis
- high precision
- parallel computation
- cascade correlation
- peer to peer
- data points
- parallel processing
- parallel computing
- back propagation