Faithful Faithfulness Evaluations: Challenges&Pitfalls Learned from a Breast MRI Case Study
Saliency maps are widely used to explain deep learning predictions in medical imaging, yet visually plausible explanations do not necessarily reflect a model's true decision process and may therefore mislead clinicians. We investigate this problem using a Vision Transformer-based breast MRI classifier trained on the OD...