An empirical study of using radiology reports and images to improve ICU mortality prediction

Mingquan Lin, Song Wang, Ying Ding, Lihui Zhao, Fei Wang +1 more
6/20/2023
cs.AIcs.CLcs.CV

No confident code implementation found for this paper.

Abstract

Background: The predictive Intensive Care Unit (ICU) scoring system plays an important role in ICU management because it predicts important outcomes, especially mortality. Many scoring systems have been developed and used in the ICU. These scoring systems are primarily based on the structured clinical data in the electronic health record (EHR), which may suffer the loss of important clinical information in the narratives and images. Methods: In this work, we build a deep learning based survival prediction model with multi-modality data to predict ICU mortality. Four sets of features are investigated: (1) physiological measurements of Simplified Acute Physiology Score (SAPS) II, (2) common thorax diseases pre-defined by radiologists, (3) BERT-based text representations, and (4) chest X-ray image features. We use the Medical Information Mart for Intensive Care IV (MIMIC-IV) dataset to evaluate the proposed model. Results: Our model achieves the average C-index of 0.7829 (95% confidence interval, 0.7620-0.8038), which substantially exceeds that of the baseline with SAPS-II features (0.7470 (0.7263-0.7676)). Ablation studies further demonstrate the contributions of pre-defined labels (2.00%), text features (2.44%), and image features (2.82%).

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Development and external validation of a multimodal artificial intelligence mortality prediction model of critically ill patients using multicenter data

87% match2025

Enhancing mortality prediction in cardiac arrest ICU patients through meta-modeling of structured clinical data from MIMIC-IV

86% match2025

Prediction of mortality and resource utilization in critical care: a deep learning approach using multimodal electronic health records with natural language processing techniques

85% match2025

A Multimodal Deep Learning Framework for Predicting ICU Deterioration: Integrating ECG Waveforms with Clinical Data and Clinician Benchmarking

85% match1 repo82026

Early Prediction of In-Hospital ICU Mortality Using Innovative First-Day Data: A Review

85% match2025

XMI-ICU: Explainable Machine Learning Model for Pseudo-Dynamic Prediction of Mortality in the ICU for Heart Attack Patients

84% match2023

Cite this paper

@article{lin2023empirical,
  title  = {An empirical study of using radiology reports and images to improve ICU mortality prediction},
  author = {Mingquan Lin and Song Wang and Ying Ding and Lihui Zhao and Fei Wang and Yifan Peng},
  year   = {2023},
  eprint = {2307.07513},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2307.07513v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2307.07513.svg)](https://codeofpaper.com/paper/2307.07513)

Discussion