What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning.
Wei LiuWeihao ZengKeqing HeYong JiangJunxian HePublished in: CoRR (2023)
Keyphrases
- data sets
- database
- data processing
- knowledge discovery
- genetic algorithm
- complex data
- data analysis
- original data
- raw data
- small number
- data mining techniques
- input data
- application domains
- statistical analysis
- training data
- data distribution
- sensor data
- missing data
- synthetic data
- computer systems
- spatial data
- data mining
- machine learning
- data acquisition
- data sources
- prior knowledge
- high quality
- historical data