Cyclic Data Parallelism for Efficient Parallelism of Deep Neural Networks.

Louis Fournier Edouard Oyallon

Published in: CoRR (2024)

Keyphrases

data parallelism
neural network
parallel processing
combinatorial search
distributed computing
shared memory
pattern recognition
genetic algorithm
search algorithm
efficient implementation