Improved Fine-tuning by Leveraging Pre-training Data: Theory and Practice.
Ziquan LiuYi XuYuanhong XuQi QianHao LiAntoni B. ChanRong JinPublished in: CoRR (2021)
Keyphrases
- fine tuning
- training data
- fine tuned
- viable alternative
- fine tune
- learning algorithm
- theoretical framework
- improved algorithm
- general theory
- supervised learning
- prior knowledge
- theoretical insights
- belief functions
- formal theory
- theoretical frameworks
- theoretical basis
- test data
- information theory
- theoretical foundation
- neural network
- computational model
- test set
- labeled data
- input data
- training set
- website
- real world