Can Pretext-Based Self-Supervised Learning Be Boosted by Downstream Data? A Theoretical Analysis.
Jiaye TengWeiran HuangPublished in: CoRR (2021)
Keyphrases
- theoretical analysis
- prior knowledge
- training data
- data sets
- database
- data sources
- small number
- learning models
- complex data
- data quality
- experimental data
- data processing
- computer systems
- learning tasks
- learning process
- background knowledge
- human experts
- raw data
- active learning
- data collection
- knowledge acquisition
- probabilistic model
- high quality
- probability distribution
- image data
- knowledge discovery
- learning algorithm
- data objects
- original data
- database systems
- numerical simulations
- missing data
- high dimensional data
- statistical analysis
- unsupervised learning
- online learning
- text classification
- end users