Differentiable Voxel-based X-ray Rendering Improves Sparse-View 3D CBCT Reconstruction

Mohammadhossein Momeni, Vivek Gopalakrishnan, Neel Dey, Polina Golland, Sarah Frisken
11/28/2024
eess.IVcs.CVphysics.med-ph

Official code: hossein-momeni/DiffVox (34 stars, MIT, last commit 2025-02-16).

Abstract

We present DiffVox, a self-supervised framework for Cone-Beam Computed Tomography (CBCT) reconstruction by directly optimizing a voxelgrid representation using physics-based differentiable X-ray rendering. Further, we investigate how the different implementations of the X-ray image formation model in the renderer affect the quality of 3D reconstruction and novel view synthesis. When combined with our regularized voxel-based learning framework, we find that using an exact implementation of the discrete Beer-Lambert law for X-ray attenuation in the renderer outperforms both widely used iterative CBCT reconstruction algorithms and modern neural field approaches, particularly when given only a few input views. As a result, we reconstruct high-fidelity 3D CBCT volumes from fewer X-rays, potentially reducing ionizing radiation exposure and improving diagnostic utility. Our implementation is available at https://github.com/hossein-momeni/DiffVox.

View on arXivView PDF

Code Implementations(1)

MIT
342Shell, PythonDec 1, 20241 years agoMIT

Similar Papers

Cite this paper

@article{momeni2024differentiable,
  title  = {Differentiable Voxel-based X-ray Rendering Improves Sparse-View 3D CBCT Reconstruction},
  author = {Mohammadhossein Momeni and Vivek Gopalakrishnan and Neel Dey and Polina Golland and Sarah Frisken},
  year   = {2024},
  eprint = {2411.19224},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2411.19224v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2411.19224.svg)](https://codeofpaper.com/paper/2411.19224)

Discussion