MedEdit: Counterfactual Diffusion-based Image Editing on Brain MRI

Malek Ben Alaya, Daniel M. Lang, Benedikt Wiestler, Julia A. Schnabel, Cosmin I. Bercea
7/21/2024
eess.IVcs.CV

No official code found. Best implementation: Malekba98/MedEdit (3 stars, GPL-3.0, last commit 2024-10-15).

Abstract

Denoising diffusion probabilistic models enable high-fidelity image synthesis and editing. In biomedicine, these models facilitate counterfactual image editing, producing pairs of images where one is edited to simulate hypothetical conditions. For example, they can model the progression of specific diseases, such as stroke lesions. However, current image editing techniques often fail to generate realistic biomedical counterfactuals, either by inadequately modeling indirect pathological effects like brain atrophy or by excessively altering the scan, which disrupts correspondence to the original images. Here, we propose MedEdit, a conditional diffusion model for medical image editing. MedEdit induces pathology in specific areas while balancing the modeling of disease effects and preserving the integrity of the original scan. We evaluated MedEdit on the Atlas v2.0 stroke dataset using Frechet Inception Distance and Dice scores, outperforming state-of-the-art diffusion-based methods such as Palette (by 45%) and SDEdit (by 61%). Additionally, clinical evaluations by a board-certified neuroradiologist confirmed that MedEdit generated realistic stroke scans indistinguishable from real ones. We believe this work will enable counterfactual image editing research to further advance the development of realistic and clinically useful imaging tools.

View on arXivView PDF

Code Implementations(1)

Malekba98/MedEditCommunity72%
GPL-3.0

Implementation of MedEdit: Counterfactual Diffusion-based Image Editing on Brain MRI in PyTorch (MICCAI 2024 - SASHIMI Workshop)

31PythonOct 14, 20242 years agoGPL-3.0

Similar Papers

Cite this paper

@article{alaya2024mededit,
  title  = {MedEdit: Counterfactual Diffusion-based Image Editing on Brain MRI},
  author = {Malek Ben Alaya and Daniel M. Lang and Benedikt Wiestler and Julia A. Schnabel and Cosmin I. Bercea},
  year   = {2024},
  eprint = {2407.15270},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.15270v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.15270.svg)](https://codeofpaper.com/paper/2407.15270)

Discussion