Enhancing In-Context Learning Performance with just SVD-Based Weight Pruning: A Theoretical Perspective.
Xinhao YaoXiaolin HuShenzhi YangYong LiuPublished in: CoRR (2024)
Keyphrases
- learning algorithm
- learning process
- learning problems
- neural network
- supervised learning
- online learning
- knowledge acquisition
- unsupervised learning
- learning analytics
- inductive learning
- learning systems
- background knowledge
- incremental learning
- weight update
- database
- learning scheme
- theoretical analysis
- context aware
- empirical studies
- probabilistic model