Phenotyping of Clinical Notes with Improved Document Classification Models Using Contextualized Neural Language Models

Andriy Mulyar, Elliot Schumacher, Masoud Rouhizadeh, Mark Dredze
10/30/2019
cs.CL

Official code: AndriyMulyar/bert_document_classification (154 stars, last commit 2021-01-17).

Abstract

Clinical notes contain an extensive record of a patient's health status, such as smoking status or the presence of heart conditions. However, this detail is not replicated within the structured data of electronic health systems. Phenotyping, the extraction of patient conditions from free clinical text, is a critical task which supports avariety of downstream applications such as decision support and secondary use of medical records. Previous work has resulted in systems which are high performing but require hand engineering, often of rules. Recent work in pretrained contextualized language models have enabled advances in representing text for a variety of tasks. We therefore explore several architectures for modeling pheno-typing that rely solely on BERT representations of the clinical note, removing the need for manual engineering. We find these architectures are competitive with or outperform existing state of the art methods on two phenotyping tasks.

View on arXivView PDF

Code Implementations(1)

AndriyMulyar/bert_document_classificationOfficial100%

architectures and pre-trained models for long document classification.

15447PythonOct 4, 20195 years ago

Similar Papers

Investigating Alternative Feature Extraction Pipelines For Clinical Note Phenotyping

83% match2023

Large Language Models to Identify Social Determinants of Health in Electronic Health Records

82% match1 repo532023

Two Directions for Clinical Data Generation with Large Language Models: Data-to-Label and Label-to-Data

81% match2023

ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmission

81% match1 repo4532019

A Pipeline for Generating Longitudinal Synthetic Clinical Notes Using Large Language Models

80% match2026

A Multi-Agent System for Autonomous, Fine-Tuning-Free Clinical Symptom Detection: Development and Validation Study

79% match2026

Cite this paper

@article{mulyar2019phenotyping,
  title  = {Phenotyping of Clinical Notes with Improved Document Classification Models Using Contextualized Neural Language Models},
  author = {Andriy Mulyar and Elliot Schumacher and Masoud Rouhizadeh and Mark Dredze},
  year   = {2019},
  eprint = {1910.13664},
  archivePrefix = {arXiv},
  url    = {https://arxiv.org/abs/1910.13664}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/1910.13664.svg)](https://codeofpaper.com/paper/1910.13664)

Discussion