Contrastive Learning Rivals Masked Image Modeling in Fine-tuning via Feature Distillation.
Yixuan WeiHan HuZhenda XieZheng ZhangYue CaoJianmin BaoDong ChenBaining GuoPublished in: CoRR (2022)
Keyphrases
- fine tuning
- image features
- image data
- input image
- image representation
- image classification
- learning algorithm
- multiscale
- image content
- learning process
- learning tasks
- single image
- low level
- spatial information
- template matching
- feature representation
- image segmentation
- preprocessing stage
- supervised learning
- edge detection
- segmentation method
- image regions
- semi supervised
- test images
- active learning
- prior knowledge
- image collections
- image retrieval
- global features
- learning environment
- similarity measure