Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts.
Tong ZhuDaize DongXiaoye QuJiacheng RuanWenliang ChenYu ChengPublished in: CoRR (2024)
Keyphrases
- data sets
- data processing
- data collection
- small number
- synthetic data
- high quality
- statistical analysis
- data points
- image data
- domain experts
- data distribution
- raw data
- data quality
- data analysis
- original data
- experimental data
- complex data
- computer systems
- attribute values
- high dimensional data
- mixture model
- end users
- data sources
- prior knowledge
- neural network