Data-Efficient Contrastive Self-supervised Learning: Most Beneficial Examples for Supervised Learning Contribute the Least.
Siddharth JoshiBaharan MirzasoleimanPublished in: ICML (2023)
Keyphrases
- supervised learning
- prior knowledge
- data sets
- data analysis
- synthetic data
- learning algorithm
- training data
- reinforcement learning
- training examples
- image data
- learning models
- labeled data
- learning tasks
- data distribution
- unsupervised learning
- data collection
- missing data
- raw data
- original data
- data quality
- data processing
- statistical analysis
- knowledge acquisition
- small number
- bayesian methods
- high quality
- learning problems
- human experts
- active learning
- accurate models
- database
- statistical learning
- neural network
- data sources
- probabilistic model
- data points
- semi supervised
- learning systems
- unlabeled data