Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression.
Yihao XueSiddharth JoshiEric GanPin-Yu ChenBaharan MirzasoleimanPublished in: ICML (2023)
Keyphrases
- selecting features
- feature vectors
- feature set
- image features
- learning process
- learning algorithm
- prior knowledge
- learning tasks
- learning models
- online learning
- positive examples
- feature extraction
- feature interactions
- active learning
- learning systems
- machine learning
- feature space
- invariant features
- inductive inference
- feature values
- discriminative features
- feature weights
- significant features
- predictive features
- average reward reinforcement learning