fRegGAN with K-space Loss Regularization for Medical Image Translation

Ivo M. Baltruschat, Felix Kreis, Alexander Hoelscher, Melanie Dohmen, Matthias Lenga
3/28/2023
eess.IVcs.CV

No official code found. Best implementation: Bayer-Group/fRegGAN (5 stars, BSD-3-Clause, last commit 2024-01-23).

Abstract

Generative adversarial networks (GANs) have shown remarkable success in generating realistic images and are increasingly used in medical imaging for image-to-image translation tasks. However, GANs tend to suffer from a frequency bias towards low frequencies, which can lead to the removal of important structures in the generated images. To address this issue, we propose a novel frequency-aware image-to-image translation framework based on the supervised RegGAN approach, which we call fRegGAN. The framework employs a K-space loss to regularize the frequency content of the generated images and incorporates well-known properties of MRI K-space geometry to guide the network training process. By combine our method with the RegGAN approach, we can mitigate the effect of training with misaligned data and frequency bias at the same time. We evaluate our method on the public BraTS dataset and outperform the baseline methods in terms of both quantitative and qualitative metrics when synthesizing T2-weighted from T1-weighted MR images. Detailed ablation studies are provided to understand the effect of each modification on the final performance. The proposed method is a step towards improving the performance of image-to-image translation and synthesis in the medical domain and shows promise for other applications in the field of image processing and generation.

View on arXivView PDF

Code Implementations(1)

Bayer-Group/fRegGANCommunity100%
BSD-3-Clause
50Python, DockerfileSep 1, 20232 years agoBSD-3-Clause
beat-undefined

Similar Papers

Cite this paper

@article{baltruschat2023freggan,
  title  = {fRegGAN with K-space Loss Regularization for Medical Image Translation},
  author = {Ivo M. Baltruschat and Felix Kreis and Alexander Hoelscher and Melanie Dohmen and Matthias Lenga},
  year   = {2023},
  eprint = {2303.15938},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2303.15938v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2303.15938.svg)](https://codeofpaper.com/paper/2303.15938)

Discussion