A Large Model for Non-invasive and Personalized Management of Breast Cancer from Multiparametric MRI

Luyang Luo, Mingxiang Wu, Mei Li, Yi Xin, Qiong Wang +6 more
8/8/2024
cs.CVcs.AI

Official code: LLYXC/MOME (23 stars, Apache-2.0, last commit 2025-07-14).

Abstract

Breast Magnetic Resonance Imaging (MRI) demonstrates the highest sensitivity for breast cancer detection among imaging modalities and is standard practice for high-risk women. Interpreting the multi-sequence MRI is time-consuming and prone to subjective variation. We develop a large mixture-of-modality-experts model (MOME) that integrates multiparametric MRI information within a unified structure, leveraging breast MRI scans from 5,205 female patients in China for model development and validation. MOME matches four senior radiologists' performance in identifying breast cancer and outperforms a junior radiologist. The model is able to reduce unnecessary biopsies in Breast Imaging-Reporting and Data System (BI-RADS) 4 patients, classify triple-negative breast cancer, and predict pathological complete response to neoadjuvant chemotherapy. MOME further supports inference with missing modalities and provides decision explanations by highlighting lesions and measuring modality contributions. To summarize, MOME exemplifies an accurate and robust multimodal model for noninvasive, personalized management of breast cancer patients via multiparametric MRI. Code is available at https://github.com/LLYXC/MOME/tree/main.

View on arXivView PDF

Code Implementations(1)

LLYXC/MOMEOfficial100%
Apache-2.0
230Shell, PythonAug 16, 20241 years agoApache-2.0

Similar Papers

DBT-DINO: Towards Foundation model based analysis of Digital Breast Tomosynthesis

85% match2025

Using Multiparametric MRI with Optimized Synthetic Correlated Diffusion Imaging to Enhance Breast Cancer Pathologic Complete Response Prediction

84% match2024

Toward explainable AI approaches for breast imaging: adapting foundation models to diverse populations

84% match2025

Integrating AI for Human-Centric Breast Cancer Diagnostics: A Multi-Scale and Multi-View Swin Transformer Framework

83% match2025

Variational U-Net with Local Alignment for Joint Tumor Extraction and Registration (VALOR-Net) of Breast MRI Data Acquired at Two Different Field Strengths

83% match2025

Ultrasound-based detection and malignancy prediction of breast lesions eligible for biopsy: A multi-center clinical-scenario study using nomograms, large language models, and radiologist evaluation

83% match2025

Cite this paper

@article{luo2024large,
  title  = {A Large Model for Non-invasive and Personalized Management of Breast Cancer from Multiparametric MRI},
  author = {Luyang Luo and Mingxiang Wu and Mei Li and Yi Xin and Qiong Wang and Varut Vardhanabhuti and Winnie CW Chu and Zhenhui Li and Juan Zhou and Pranav Rajpurkar and Hao Chen},
  year   = {2024},
  eprint = {2408.12606},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2408.12606v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2408.12606.svg)](https://codeofpaper.com/paper/2408.12606)

Discussion