What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation.
Aaditya K. SinghTed MoskovitzFelix HillStephanie C. Y. ChanAndrew M. SaxePublished in: CoRR (2024)
Keyphrases
- inductive inference
- inductive learning
- learning algorithm
- concept learning
- empirical studies
- learning systems
- reinforcement learning
- learning process
- prior knowledge
- high speed
- online learning
- learning tasks
- learning problems
- individual differences
- eye tracking
- computer assisted instruction
- students learning
- socio cultural
- group formation
- experimental design
- contextual information
- supervised learning
- active learning
- bayesian networks