Merging Experts into One: Improving Computational Efficiency of Mixture of Experts.

Shwai He Run-Ze Fan Liang Ding Li Shen Tianyi Zhou Dacheng Tao

Published in: EMNLP (2023)

Keyphrases

computational efficiency
computationally efficient
solution quality
mixture model
efficient computation
computational complexity
database
machine learning
expert finding
merging algorithm
numerical stability
domain experts
multiscale
similarity measure
database systems
genetic algorithm
databases
real time