Bridging The Gaps Between Token Pruning and Full Pre-training via Masked Fine-tuning.
Fengyuan ShiLimin WangPublished in: CoRR (2023)
Keyphrases
- fine tuning
- fine tuned
- viable alternative
- fine tune
- training set
- avoid overfitting
- search space
- pruning method
- online learning
- training samples
- training phase
- data mining
- databases
- training examples
- training process
- database
- supervised learning
- pruning algorithm
- evolutionary algorithm
- information systems
- artificial intelligence