LLaVA-MoLE: Sparse Mixture of LoRA Experts for Mitigating Data Conflicts in Instruction Finetuning MLLMs.
Shaoxiang ChenZequn JieLin MaPublished in: CoRR (2024)
Keyphrases
- data sets
- data structure
- original data
- missing data
- data collection
- data processing
- sparse data
- raw data
- synthetic data
- high dimensional data
- database
- risk management
- domain experts
- training data
- computational intelligence
- image data
- probability distribution
- data sources
- data analysis
- multi agent
- high quality
- computer systems
- computer science
- database systems
- human experts
- e learning
- artificial intelligence
- data quality
- prior knowledge