ScheMoE: An Extensible Mixture-of-Experts Distributed Training System with Tasks Scheduling.
Shaohuai ShiXinglin PanQiang WangChengjian LiuXiaozhe RenZhongzhe HuYu YangBo LiXiaowen ChuPublished in: EuroSys (2024)
Keyphrases
- computational grids
- meeting scheduling
- scheduling problem
- distributed environment
- distributed systems
- scheduling algorithm
- dynamic scheduling
- training set
- data model
- data sets
- round robin
- application specific
- online learning
- resource allocation
- lightweight
- computer networks
- active learning
- real time database systems
- load balancing
- distributed data
- supervised learning
- hidden markov models
- feature selection