Transfer Learning or Self-supervised Learning? A Tale of Two Pretraining Paradigms.
Xingyi YangXuehai HeYuxiao LiangYue YangShanghang ZhangPengtao XiePublished in: CoRR (2020)
Keyphrases
- transfer learning
- learning tasks
- knowledge transfer
- reinforcement learning
- learning algorithm
- transfer knowledge
- multi task learning
- active learning
- machine learning
- transferring knowledge
- learning process
- sample selection bias
- semi supervised learning
- graph transduction
- learning problems
- prior knowledge
- neural network
- text mining
- multi task
- collaborative filtering
- domain adaptation
- supervised learning
- manifold alignment
- data analysis
- similarity measure
- solve complex tasks