Can Pretext-Based Self-Supervised Learning Be Boosted by Downstream Data? A Theoretical Analysis.
Jiaye TengWeiran HuangHaowei HePublished in: AISTATS (2022)
Keyphrases
- theoretical analysis
- data sets
- prior knowledge
- high quality
- synthetic data
- statistical analysis
- database
- learning algorithm
- training data
- raw data
- data distribution
- background knowledge
- training examples
- data quality
- human experts
- learning tasks
- experimental data
- domain experts
- missing data
- supervised learning
- image data
- relational databases
- learning process
- statistical methods
- bayesian methods
- hidden variables
- e learning
- original data
- numerical simulations
- neural network
- machine learning
- active learning
- knowledge discovery
- online learning
- data collection
- high dimensional data