Aurora: Activating Chinese chat capability for Mixtral-8x7B sparse Mixture-of-Experts through Instruction-Tuning.
Rongsheng WangHaoming ChenRuizhe ZhouYaofei DuanKunyan CaiHan MaJiaxi CuiJian LiPatrick Cheong-Iao PangYapeng WangTao TanPublished in: CoRR (2023)
Keyphrases
- mixture model
- multimedia
- sparse data
- computer supported collaborative learning
- computer mediated communication
- social intelligence design
- learning process
- domain experts
- computer technology
- gaussian distribution
- text summarization
- computer assisted instruction
- chinese text
- gaussian mixture model
- knowledge base
- cooperative learning
- high dimensional
- instruction set
- synchronous communication