Pipeline MoE: A Flexible MoE Implementation with Pipeline Parallelism.

Xin Chen Hengheng Zhang Xiaotao Gu Kaifeng Bi Lingxi Xie Qi Tian

Published in: CoRR (2023)

Keyphrases

parallel architecture
parallel processing
probabilistic model
parallel computers
processing pipeline
database
search algorithm
computer systems
computational power