Zen: Near-Optimal Sparse Tensor Synchronization for Distributed DNN Training.
Zhuang WangZhaozhuo XuAnshumali ShrivastavaT. S. Eugene NgPublished in: CoRR (2023)
Keyphrases
- training process
- distributed systems
- distributed environment
- tensor decomposition
- high order
- test set
- cooperative
- sparse data
- multi agent
- computer networks
- high dimensional
- medical images
- reduced set
- sparse matrix
- tensor factorization
- training set
- multi agent systems
- chaotic systems
- avoid overfitting
- data sets
- training algorithm
- mobile agents
- lightweight
- peer to peer
- dimensionality reduction
- higher order
- semi supervised
- neural network