In-context Learning and Induction Heads.
Catherine OlssonNelson ElhageNeel NandaNicholas JosephNova DasSarmaTom HenighanBen MannAmanda AskellYuntao BaiAnna ChenTom ConerlyDawn DrainDeep GanguliZac Hatfield-DoddsDanny HernandezScott JohnstonAndy JonesJackson KernionLiane LovittKamal NdousseDario AmodeiTom BrownJack ClarkJared KaplanSam McCandlishChris OlahPublished in: CoRR (2022)
Keyphrases
- learning process
- learning systems
- inductive learning
- prior knowledge
- supervised learning
- learning contexts
- learning algorithm
- mobile learning
- unsupervised learning
- information systems
- mobile robot
- user interface
- higher education
- artificial neural networks
- learning problems
- incremental learning
- concept learning
- learning scheme
- inductive inference
- explanation based learning
- search engine