What Do VLMs NOTICE? A Mechanistic Interpretability Pipeline for Noise-free Text-Image Corruption and Evaluation.
Michal GolovanevskyWilliam RudmanVedant PalitRitambhara SinghCarsten EickhoffPublished in: CoRR (2024)
Keyphrases
- free text
- image noise
- random noise
- image structure
- input image
- multiscale
- structured data
- information extraction
- processing pipeline
- image retrieval
- image features
- image edges
- edge detection
- semi structured
- image segmentation
- spatial information
- gaussian noise
- computer assisted assessment
- database
- signal to noise ratio
- relational databases
- information systems
- artificial intelligence