Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts.
Basil MustafaCarlos RiquelmeJoan PuigcerverRodolphe JenattonNeil HoulsbyPublished in: CoRR (2022)
Keyphrases
- image analysis
- learning process
- image data
- single image
- programming language
- image content
- image representation
- learning algorithm
- template matching
- pattern languages
- multiscale
- image collections
- test images
- image regions
- learning tasks
- unsupervised learning
- edge detection
- input image
- image pixels
- active learning
- prior knowledge
- language acquisition
- language learning
- knowledge acquisition
- gaussian mixture
- object oriented programming
- region of interest
- domain experts
- image classification
- supervised learning
- image features
- low level
- natural language
- similarity measure
- image segmentation