Benchmarking network fabrics for data distributed training of deep neural networks.
Siddharth SamsiAndrew ProutMichael JonesAndrew C. KirbyBill ArcandBill BergeronDavid BestorChansup ByunVijay GadepallyMichael HouleMatthew HubbellAnna KleinPeter MichaleasLauren MilechinJulie MullenAntonio RosaCharles YeeAlbert ReutherJeremy KepnerPublished in: HPEC (2020)
Keyphrases
- neural network
- data transfer
- distributed network
- data sets
- peer to peer
- data analysis
- data sources
- data processing
- distributed data
- computer networks
- database
- image data
- data collection
- network structure
- computer systems
- communication overhead
- training data
- heterogeneous data
- training process
- complex networks
- data structure
- training algorithm
- distributed systems
- data points
- xml documents
- pattern recognition