Pipeline Parallelism with Controllable Memory.
Penghui QiXinyi WanNyamdavaa AmarMin LinPublished in: CoRR (2024)
Keyphrases
- computational power
- level parallelism
- memory usage
- memory requirements
- parallel processing
- neural network
- computing power
- massively parallel
- memory bandwidth
- memory capacity
- main memory
- shared memory
- artificial neural networks
- case study
- artificial intelligence
- memory space
- limited memory
- processing elements
- fine grain
- low memory
- real world
- data sets
- database