Login / Signup

Lazarus: Resilient and Elastic Training of Mixture-of-Experts Models with Adaptive Expert Placement.

Yongji WuWenjie QuTianyang TaoZhuang WangWei BaiZhuohao LiYuan TianJiaheng ZhangMatthew LentzDanyang Zhuo
Published in: CoRR (2024)
Keyphrases
  • domain experts
  • decision trees
  • statistical models
  • random fields
  • gaussian model
  • data sets
  • prior knowledge
  • probability distribution
  • semi supervised
  • process model
  • training algorithm
  • structured prediction