A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity.
Shayne LongpreGregory YauneyEmily ReifKatherine LeeAdam RobertsBarret ZophDenny ZhouJason WeiKevin RobinsonDavid MimnoDaphne IppolitoPublished in: CoRR (2023)
Keyphrases
- training data
- high quality
- data sets
- data quality
- image data
- noisy data
- data analysis
- raw data
- prior knowledge
- test data
- data processing
- data samples
- training examples
- small number
- data collection
- social networks
- original data
- domain experts
- synthetic data
- computer systems
- input data
- high dimensional data
- missing data
- statistical analysis
- experimental data
- knowledge discovery
- probability distribution
- data structure
- incomplete data
- database