HetSeq: Distributed GPU Training on Heterogeneous Infrastructure.
Yifan DingNicholas BotzerTim WeningerPublished in: AAAI (2021)
Keyphrases
- loosely coupled
- highly distributed
- heterogeneous environments
- computing environments
- heterogeneous data
- distributed information systems
- real time
- distributed systems
- commodity hardware
- distributed environment
- distributed data
- heterogeneous systems
- data transfer
- mobile agents
- heterogeneous databases
- distributed storage
- multi agent
- mission critical
- distributed heterogeneous
- distributed data sources
- heterogeneous networks
- computer networks
- training samples
- distributed search
- computing platform
- distributed data mining
- information dissemination
- geographically distributed
- distributed architecture
- resource sharing
- training phase
- test set
- peer to peer
- web services