Scaling Clinical Trial Matching Using Large Language Models: A Case Study in Oncology

Cliff Wong, Sheng Zhang, Yu Gu, Christine Moung, Jacob Abel +6 more
8/4/2023
cs.CLcs.LG

No official code found. Best implementation: microsoft/CTM-LLM (7 stars, MIT, last commit 2025-02-12).

Abstract

Clinical trial matching is a key process in health delivery and discovery. In practice, it is plagued by overwhelming unstructured data and unscalable manual processing. In this paper, we conduct a systematic study on scaling clinical trial matching using large language models (LLMs), with oncology as the focus area. Our study is grounded in a clinical trial matching system currently in test deployment at a large U.S. health network. Initial findings are promising: out of box, cutting-edge LLMs, such as GPT-4, can already structure elaborate eligibility criteria of clinical trials and extract complex matching logic (e.g., nested AND/OR/NOT). While still far from perfect, LLMs substantially outperform prior strong baselines and may serve as a preliminary solution to help triage patient-trial candidates with humans in the loop. Our study also reveals a few significant growth areas for applying LLMs to end-to-end clinical trial matching, such as context limitation and accuracy, especially in structuring patient information from longitudinal medical records.

View on arXivView PDF

Code Implementations(1)

microsoft/CTM-LLMCommunity60%
MIT

Resources to accompany "Scaling Clinical Trial Matching Using Large Language Models: A Case Study in Oncology" (MLHC 2023)

70PythonAug 4, 20231 years agoMIT

Similar Papers

Cite this paper

@article{wong2023scaling,
  title  = {Scaling Clinical Trial Matching Using Large Language Models: A Case Study in Oncology},
  author = {Cliff Wong and Sheng Zhang and Yu Gu and Christine Moung and Jacob Abel and Naoto Usuyama and Roshanthi Weerasinghe and Brian Piening and Tristan Naumann and Carlo Bifulco and Hoifung Poon},
  year   = {2023},
  eprint = {2308.02180},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2308.02180v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2308.02180.svg)](https://codeofpaper.com/paper/2308.02180)

Discussion