Scaling Laws and Interpretability of Learning from Repeated Data.
Danny HernandezTom B. BrownTom ConerlyNova DasSarmaDawn DrainSheer El ShowkNelson ElhageZac Hatfield-DoddsTom HenighanTristan HumeScott JohnstonBenjamin MannChris OlahCatherine OlssonDario AmodeiNicholas JosephJared KaplanSam McCandlishPublished in: CoRR (2022)
Keyphrases
- data sets
- data structure
- prior knowledge
- learning algorithm
- raw data
- database
- training data
- original data
- online learning
- image data
- data collection
- data sources
- learning process
- data distribution
- missing data
- databases
- knowledge acquisition
- experimental data
- input data
- data points
- data analysis
- human experts
- data quality
- bayesian methods
- attribute values
- learning systems
- data processing
- small number
- knowledge discovery
- high dimensional
- database systems