Janus: A Unified Distributed Training Framework for Sparse Mixture-of-Experts Models.

Juncai Liu Jessie Hui Wang Yimin Jiang

Published in: SIGCOMM (2023)

Keyphrases

probabilistic model
main contribution
modeling framework
high dimensional
bayesian framework
distributed systems
parameter estimation
unified model
neural network
multi agent
training set
mixture model
lightweight
latent variable models
elastic net