Communication-minimizing Asynchronous Tensor Parallelism.
Siddharth SinghZack SatingAbhinav BhatelePublished in: CoRR (2023)
Keyphrases
- asynchronous communication
- message transmission
- higher order
- high order
- parallel processing
- information sharing
- communication networks
- communication systems
- shared memory
- information exchange
- instant messaging
- data sets
- computer networks
- communication channels
- communication technologies
- massively parallel
- fine grain
- tensor product
- data acquisition
- mobile devices