Identifying Semantic Induction Heads to Understand In-Context Learning.
Jie RenQipeng GuoHang YanDongrui LiuQuanshi ZhangXipeng QiuDahua LinPublished in: ACL (Findings) (2024)
Keyphrases
- learning process
- inductive learning
- learning algorithm
- prior knowledge
- online learning
- learning systems
- inductive inference
- context dependent
- learning tasks
- concept learning
- constructive induction
- knowledge acquisition
- contextual information
- knowledge retrieval
- explanation based learning
- data sets
- training set
- reinforcement learning
- training data
- machine learning