Data Distributional Properties Drive Emergent In-Context Learning in Transformers.
Stephanie C. Y. ChanAdam SantoroAndrew K. LampinenJane X. WangAaditya SinghPierre H. RichemondJay McClellandFelix HillPublished in: CoRR (2022)
Keyphrases
- data sets
- data collection
- online learning
- raw data
- data analysis
- learning models
- learning algorithm
- prior knowledge
- data structure
- database
- input data
- unsupervised learning
- attribute values
- small number
- spatial data
- computer systems
- synthetic data
- learning systems
- background knowledge
- e learning
- data distribution
- human experts
- data objects
- knowledge acquisition
- semi supervised
- data sources
- active learning
- learning process
- high quality
- learning environment