Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLMs.
Yuxin ZhangLirui ZhaoMingbao LinYunyun SunYiwu YaoXingjia HanJared TannerShiwei LiuRongrong JiPublished in: ICLR (2024)
Keyphrases
- fine tuning
- training algorithm
- supervised learning
- avoid overfitting
- sparse data
- dynamic environments
- training examples
- test set
- information systems
- fine tuned
- compressed sensing
- feedforward neural networks
- training phase
- linear combination
- high dimensional
- training set
- training process
- online learning
- compressive sensing
- least squares
- linear svm
- reduced set
- multiscale
- neural network