HetSeq: Distributed GPU Training on Heterogeneous Infrastructure.
Yifan DingNicholas BotzerTim WeningerPublished in: CoRR (2020)
Keyphrases
- highly distributed
- loosely coupled
- computing environments
- commodity hardware
- distributed environment
- multi agent
- distributed systems
- heterogeneous systems
- heterogeneous environments
- heterogeneous databases
- distributed information systems
- geographically distributed
- mission critical
- heterogeneous data
- distributed data
- peer to peer
- training set
- cooperative
- configuration management
- transparent access
- heterogeneous wireless sensor networks
- resource sharing
- data transfer
- training examples
- data collection
- supervised learning
- distributed architecture
- heterogeneous data sources
- parallel implementation
- parallel processing
- graphics processors
- distributed data sources
- distributed storage
- e learning
- real time