MPI-rical: Data-Driven MPI Distributed Parallelism Assistance with Transformers.
Nadav SchneiderTal KadoshNiranjan HasabnisTimothy MattsonYuval PinterGal OrenPublished in: CoRR (2023)
Keyphrases
- data driven
- shared memory
- message passing interface
- parallel computing
- parallel algorithm
- message passing
- massively parallel
- high performance computing
- parallel implementation
- parallel computers
- distributed systems
- parallel programming
- parallel execution
- general purpose
- parallelization strategy
- parallel architectures
- commodity hardware
- distributed data
- parallel processing
- distributed memory
- computer networks
- multithreading
- fault tolerant
- neural network
- parallel computation
- distributed computing
- communication overhead
- mobile agents
- peer to peer
- cooperative