Swing: Short-cutting Rings for Higher Bandwidth Allreduce.

Daniele De Sensi Tommaso Bonato David Saam Torsten Hoefler

Published in: CoRR (2024)

Keyphrases

high bandwidth
data sets
significantly higher
higher quality
databases
neural network
real world
information systems
multiscale
sensor networks
response time
lower levels
bandwidth allocation
transmission scheme