ECG-FM: An Open Electrocardiogram Foundation Model

Kaden McKeen, Sameer Masood, Augustin Toma, Barry Rubin, Bo Wang
8/9/2024
cs.LG

Official code: bowang-lab/ecg-fm (320 stars, MIT, last commit 2026-01-14). 1 more implementation below.

Abstract

Conventional task-specific electrocardiogram (ECG) analysis models require large annotated datasets to train. Foundation models mitigate this burden by leveraging self-supervised pretraining; however, the scarcity of open-weight ECG foundation models hinders adoption and cross-study comparability. We present ECG-FM, an open foundation model for ECG analysis, and conduct a study using a dataset of 1.5 million ECGs. ECG-FM is a transformer-based model pretrained using a hybrid contrastive and generative self-supervised learning approach. Our downstream tasks include predicting reduced left ventricular ejection fraction (LVEF) and ECG interpretation labels, where we release a benchmark task on the MIMIC-IV-ECG dataset. We affirm that ECG-FM is robust, label-efficient, and functionally discriminative by showcasing data scaling experiments, performing a latent space analysis, and generating saliency maps. ECG-FM markedly outperforms task-specific models in the small-to-medium-scale data regime and demonstrates cross-dataset generalizability, achieving high AUROC on many clinically salient labels such as atrial fibrillation (0.996) and LVEF<=40% (0.929). We release our code, model weights, and benchmark task at https://github.com/bowang-lab/ECG-FM/.

View on arXivView PDF

Code Implementations(2)

bowang-lab/ecg-fmOfficial100%
MIT

An electrocardiogram analysis foundation model.

32038Python, Jupyter NotebookMay 27, 20249 months agoMIT
electrocardiogramfoundation-modelshealthcaremachine-learningmimic-iv-ecg+2 more
PyTorch

A collection of deep learning models for ECG data processing based on fairseq framework

15433C++, CudaAug 4, 20216 months agoNOASSERTION
ecgekgfairseqpythonpytorch

Similar Papers

Cite this paper

@article{mckeen2024ecgfm,
  title  = {ECG-FM: An Open Electrocardiogram Foundation Model},
  author = {Kaden McKeen and Sameer Masood and Augustin Toma and Barry Rubin and Bo Wang},
  year   = {2024},
  eprint = {2408.05178},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2408.05178v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2408.05178.svg)](https://codeofpaper.com/paper/2408.05178)

Discussion