Multimodal Contrastive Learning with LIMoE: the Language-Image Mixture of Experts.
Basil MustafaCarlos RiquelmeJoan PuigcerverRodolphe JenattonNeil HoulsbyPublished in: NeurIPS (2022)
Keyphrases
- image data
- multiscale
- learning process
- image analysis
- learning algorithm
- image content
- image features
- template matching
- edge detection
- single image
- natural language
- image segmentation
- image representation
- unsupervised learning
- online learning
- keypoints
- input image
- inductive inference
- image retrieval
- reinforcement learning
- language acquisition
- test images
- medical images
- pattern languages
- image regions
- segmentation method
- knowledge acquisition
- image compression
- supervised learning
- wavelet transform
- computer vision