Accelerating Distributed MoE Training and Inference with Lina.
Jiamin LiYimin JiangYibo ZhuCong WangHong XuPublished in: USENIX Annual Technical Conference (2023)
Keyphrases
- distributed systems
- structured prediction
- cooperative
- peer to peer
- probabilistic inference
- neural network
- distributed data
- test set
- fault tolerant
- distributed network
- database
- inference mechanism
- distributed architecture
- inference engine
- belief networks
- distributed environment
- supervised learning
- web services
- computer networks
- training samples
- lightweight
- information systems