NCA-Morph: Medical Image Registration with Neural Cellular Automata

Amin Ranem, John Kalkhof, Anirban Mukhopadhyay
10/29/2024
cs.CV

No official code found. Best implementation: MECLabTUDA/NCA-Morph (5 stars, Apache-2.0, last commit 2024-08-29).

Abstract

Medical image registration is a critical process that aligns various patient scans, facilitating tasks like diagnosis, surgical planning, and tracking. Traditional optimization based methods are slow, prompting the use of Deep Learning (DL) techniques, such as VoxelMorph and Transformer-based strategies, for faster results. However, these DL methods often impose significant resource demands. In response to these challenges, we present NCA-Morph, an innovative approach that seamlessly blends DL with a bio-inspired communication and networking approach, enabled by Neural Cellular Automata (NCAs). NCA-Morph not only harnesses the power of DL for efficient image registration but also builds a network of local communications between cells and respective voxels over time, mimicking the interaction observed in living systems. In our extensive experiments, we subject NCA-Morph to evaluations across three distinct 3D registration tasks, encompassing Brain, Prostate and Hippocampus images from both healthy and diseased patients. The results showcase NCA-Morph's ability to achieve state-of-the-art performance. Notably, NCA-Morph distinguishes itself as a lightweight architecture with significantly fewer parameters; 60% and 99.7% less than VoxelMorph and TransMorph. This characteristic positions NCA-Morph as an ideal solution for resource-constrained medical applications, such as primary care settings and operating rooms.

View on arXivView PDF

Code Implementations(1)

Apache-2.0

Official PyTorch code base for our BMVC 2024 published paper NCA-Morph: Medical Image Registration with Neural Cellular Automata.

51Shell, PythonAug 29, 20242 years agoApache-2.0
medical-image-registrationneural-cellular-automata

Similar Papers

Cite this paper

@article{ranem2024ncamorph,
  title  = {NCA-Morph: Medical Image Registration with Neural Cellular Automata},
  author = {Amin Ranem and John Kalkhof and Anirban Mukhopadhyay},
  year   = {2024},
  eprint = {2410.22265},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2410.22265v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2410.22265.svg)](https://codeofpaper.com/paper/2410.22265)

Discussion