ResIST: Layer-wise decomposition of ResNets for distributed training.
Chen DunCameron R. WolfeChristopher M. JermaineAnastasios KyrillidisPublished in: UAI (2022)
Keyphrases
- distributed systems
- hierarchical architecture
- cooperative
- training phase
- training process
- multi layer
- communication cost
- computer networks
- distributed environment
- mobile agents
- training examples
- peer to peer
- multi agent
- lightweight
- supervised learning
- database
- decomposition algorithm
- training set
- fault tolerant
- image decomposition
- single layer
- communication overhead
- load balancing
- decomposition method
- training algorithm
- pairwise
- similarity measure
- learning algorithm
- machine learning