Denoising diffusion models for high-resolution microscopy image restoration

Pamela Osuna-Vargas, Maren H. Wehrheim, Lucas Zinz, Johanna Rahm, Ashwin Balakrishnan +3 more
9/18/2024
eess.IVcs.CVcs.LG

No official code found. Best implementation: kaschube-lab/ddpm_highres_microscopy (5 stars, MIT, last commit 2025-08-22).

Abstract

Advances in microscopy imaging enable researchers to visualize structures at the nanoscale level thereby unraveling intricate details of biological organization. However, challenges such as image noise, photobleaching of fluorophores, and low tolerability of biological samples to high light doses remain, restricting temporal resolutions and experiment durations. Reduced laser doses enable longer measurements at the cost of lower resolution and increased noise, which hinders accurate downstream analyses. Here we train a denoising diffusion probabilistic model (DDPM) to predict high-resolution images by conditioning the model on low-resolution information. Additionally, the probabilistic aspect of the DDPM allows for repeated generation of images that tend to further increase the signal-to-noise ratio. We show that our model achieves a performance that is better or similar to the previously best-performing methods, across four highly diverse datasets. Importantly, while any of the previous methods show competitive performance for some, but not all datasets, our method consistently achieves high performance across all four data sets, suggesting high generalizability.

View on arXivView PDF

Code Implementations(1)

MIT

Code accompanying the paper "Denoising diffusion models for high-resolution microscopy image restoration", accepted at WACV 2025.

51Shell, PythonOct 31, 20241 years agoMIT

Similar Papers

Cite this paper

@article{osunavargas2024denoising,
  title  = {Denoising diffusion models for high-resolution microscopy image restoration},
  author = {Pamela Osuna-Vargas and Maren H. Wehrheim and Lucas Zinz and Johanna Rahm and Ashwin Balakrishnan and Alexandra Kaminer and Mike Heilemann and Matthias Kaschube},
  year   = {2024},
  eprint = {2409.12078},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2409.12078v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2409.12078.svg)](https://codeofpaper.com/paper/2409.12078)

Discussion