Expected Grad-CAM: Towards gradient faithfulness

Vincenzo Buono, Peyman Sheikholharam Mashhadi, Mahmoud Rahat, Prayag Tiwari, Stefan Byttner
6/3/2024
cs.LGcs.CV

No official code found. Best implementation: espressoshock/pytorch-expected-gradcam (1 star, last commit 2024-06-24).

Abstract

Although input-gradients techniques have evolved to mitigate and tackle the challenges associated with gradients, modern gradient-weighted CAM approaches still rely on vanilla gradients, which are inherently susceptible to the saturation phenomena. Despite recent enhancements have incorporated counterfactual gradient strategies as a mitigating measure, these local explanation techniques still exhibit a lack of sensitivity to their baseline parameter. Our work proposes a gradient-weighted CAM augmentation that tackles both the saturation and sensitivity problem by reshaping the gradient computation, incorporating two well-established and provably approaches: Expected Gradients and kernel smoothing. By revisiting the original formulation as the smoothed expectation of the perturbed integrated gradients, one can concurrently construct more faithful, localized and robust explanations which minimize infidelity. Through fine modulation of the perturbation distribution it is possible to regulate the complexity characteristic of the explanation, selectively discriminating stable features. Our technique, Expected Grad-CAM, differently from recent works, exclusively optimizes the gradient computation, purposefully designed as an enhanced substitute of the foundational Grad-CAM algorithm and any method built therefrom. Quantitative and qualitative evaluations have been conducted to assess the effectiveness of our method.

View on arXivView PDF

Code Implementations(1)

Distribution sampling and kernel smoothing for a more robust Grad-CAM alternative.

10Jun 3, 20242 years ago

Similar Papers

Cite this paper

@article{buono2024expected,
  title  = {Expected Grad-CAM: Towards gradient faithfulness},
  author = {Vincenzo Buono and Peyman Sheikholharam Mashhadi and Mahmoud Rahat and Prayag Tiwari and Stefan Byttner},
  year   = {2024},
  eprint = {2406.01274},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2406.01274v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2406.01274.svg)](https://codeofpaper.com/paper/2406.01274)

Discussion