Investigating the Pre-Training Dynamics of In-Context Learning: Task Recognition vs. Task Learning.
Xiaolei WangXinyu TangWayne Xin ZhaoJi-Rong WenPublished in: CoRR (2024)
Keyphrases
- visual recognition
- learning problems
- learning algorithm
- learning process
- learning systems
- supervised learning
- recognition accuracy
- dynamical systems
- recurrent networks
- feedforward neural networks
- recognition algorithm
- incremental learning
- recurrent neural networks
- learning tasks
- neural network
- unsupervised learning
- online learning
- recognition rate
- hidden markov models
- decision trees
- machine learning
- contextual information
- learning analytics
- training process
- prior knowledge
- learning speed
- learning stage