Back-in-Time Diffusion: Unsupervised Detection of Medical Deepfakes

Fred Grabovski, Lior Yasur, Guy Amit, Yisroel Mirsky
7/21/2024
eess.IVcs.CRcs.CV

No official code found. Best implementation: FreddieMG/BTD--Unsupervised-Detection-of-Medical-Deepfakes (9 stars, MIT, last commit 2025-06-18).

Abstract

Recent progress in generative models has made it easier for a wide audience to edit and create image content, raising concerns about the proliferation of deepfakes, especially in healthcare. Despite the availability of numerous techniques for detecting manipulated images captured by conventional cameras, their applicability to medical images is limited. This limitation stems from the distinctive forensic characteristics of medical images, a result of their imaging process. In this work we propose a novel anomaly detector for medical imagery based on diffusion models. Normally, diffusion models are used to generate images. However, we show how a similar process can be used to detect synthetic content by making a model reverse the diffusion on a suspected image. We evaluate our method on the task of detecting fake tumors injected and removed from CT and MRI scans. Our method significantly outperforms other state of the art unsupervised detectors with an increased AUC of 0.9 from 0.79 for injection and of 0.96 from 0.91 for removal on average. We also explore our hypothesis using AI explainability tools and publish our code and new medical deepfake datasets to encourage further research into this domain.

View on arXivView PDF

Code Implementations(1)

MIT

"Repository for implementing the Back-in-Time Diffusion method for detecting medical deepfakes in CT and MRI scans, including training and evaluation tools."

92Python, Jupyter NotebookAug 7, 20241 years agoMIT

Similar Papers

Cite this paper

@article{grabovski2024backintime,
  title  = {Back-in-Time Diffusion: Unsupervised Detection of Medical Deepfakes},
  author = {Fred Grabovski and Lior Yasur and Guy Amit and Yisroel Mirsky},
  year   = {2024},
  eprint = {2407.15169},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.15169v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.15169.svg)](https://codeofpaper.com/paper/2407.15169)

Discussion