Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM.

Sainbayar Sukhbaatar Olga Golovneva Vasu Sharma Hu Xu Xi Victoria Lin Baptiste Rozière Jacob Kahn Daniel Li Wen-tau Yih Jason Weston Xian Li

Published in: CoRR (2024)

Keyphrases