The Role of Pre-training Data in Transfer Learning.
Rahim EntezariMitchell WortsmanOlga SaukhMoein ShariatniaHanie SedghiLudwig SchmidtPublished in: CoRR (2023)
Keyphrases
- transfer learning
- training data
- labeled data
- domain adaptation
- target domain
- semi supervised learning
- learning tasks
- unlabeled data
- learning algorithm
- training and test data
- labeled examples
- active learning
- source domain
- transfer knowledge
- knowledge transfer
- machine learning
- cross domain
- reinforcement learning
- manifold alignment
- collaborative filtering
- data sets
- supervised learning
- multi task learning
- decision trees
- multi task
- training set
- test data
- text classification
- class labels
- labeled training data
- semi supervised
- domain knowledge
- text categorization
- transferring knowledge
- training examples
- prior knowledge
- label information
- nearest neighbor
- co training
- test set
- information extraction
- knowledge representation
- databases