RTP: Rethinking Tensor Parallelism with Memory Deduplication.

Cheng Luo Tianle Zhong Geoffrey Fox

Published in: CoRR (2023)

Keyphrases

computational power
end to end
memory requirements
parallel processing
high order
higher order
memory usage
memory size
parallel computing
massively parallel
information processing
computing power
memory space
limited memory
database systems
record linkage
diffusion tensor
processing elements
multithreading