Scaling the Wild: Decentralizing Hogwild!-style Shared-memory SGD.
Bapi ChatterjeeVyacheslav KungurtsevDan AlistarhPublished in: CoRR (2022)
Keyphrases
- shared memory
- message passing
- parallel algorithm
- distributed memory
- parallel computing
- parallel programming
- parallel architectures
- parallel computation
- multi processor
- low overhead
- shared memory multiprocessors
- address space
- database systems
- parallel machines
- belief propagation
- stochastic gradient descent
- interprocess communication
- parallel computers
- parallel architecture
- markov random field
- graphical models
- parallel execution
- general purpose
- high quality
- compute unified device architecture
- multi core systems
- real time