arxivcs.CV2026-07-20
Attention Without Grounding: Causal Evaluation of Visual Explanations in Medical VLMs
Binesh Sadanandan, Vahid Behzadan
Attention and saliency heatmaps are widely used to explain medical Vision-Language Model (VLM) outputs on chest X-rays, yet whether they truly highlight the image evidence driving predictions has not been causally tested. We audit faithfulness via overlap with radiologist boundin…