How Do Transformers Learn In-Context Beyond Simple Functions? A Case Study on Learning with Representations.
Tianyu GuoWei HuSong MeiHuan WangCaiming XiongSilvio SavareseYu BaiPublished in: CoRR (2023)
Keyphrases
- learning process
- learning algorithm
- efficient learning
- prior knowledge
- learning systems
- learning rules
- learning scheme
- neural network
- contextual information
- context aware
- knowledge acquisition
- online learning
- unsupervised learning
- learning tasks
- learning problems
- incremental learning
- context sensitive
- learning analytics
- active learning
- reinforcement learning
- iterative learning
- children learn
- external representations