Identifying Semantic Induction Heads to Understand In-Context Learning.
Jie RenQipeng GuoHang YanDongrui LiuXipeng QiuDahua LinPublished in: CoRR (2024)
Keyphrases
- learning process
- prior knowledge
- explanation based learning
- learning systems
- active learning
- knowledge acquisition
- reinforcement learning
- context dependent
- online learning
- domain independent
- background knowledge
- constructive induction
- neural network
- concept learning
- mobile learning
- contextual information
- unsupervised learning
- collaborative learning
- domain specific
- low level
- learning algorithm