MoEBERT: from BERT to Mixture-of-Experts via Importance-Guided Adaptation.

Simiao Zuo Qingru Zhang Chen Liang Pengcheng He Tuo Zhao Weizhu Chen

Published in: CoRR (2022)

Keyphrases

mixture model
relative importance
decision making
multimedia
expectation maximization
adaptation strategies
data mining
learning algorithm
computer vision
multi agent systems
domain experts