Evaluation of AI Chatbots for Patient-Specific EHR Questions

Alaleh Hamidi, Kirk Roberts
6/5/2023
cs.CLcs.AIcs.IR

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

This paper investigates the use of artificial intelligence chatbots for patient-specific question answering (QA) from clinical notes using several large language model (LLM) based systems: ChatGPT (versions 3.5 and 4), Google Bard, and Claude. We evaluate the accuracy, relevance, comprehensiveness, and coherence of the answers generated by each model using a 5-point Likert scale on a set of patient-specific questions.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Dynamic Q&A of Clinical Documents with Large Language Models

87% match2024

The complexities of patient-centred conversational artificial intelligence

87% match2026

The impact of responding to patient messages with large language model assistance

86% match1 repo72023

Addressing accuracy and hallucination of LLMs in Alzheimer's disease research through knowledge graphs

84% match2025

Enhancing Healthcare through Large Language Models: A Study on Medical Question Answering

84% match2024

MKA: A Scalable Medical Knowledge Assisted Mechanism for Generative Models on Medical Conversation Tasks

84% match2023

Cite this paper

@article{hamidi2023evaluation,
  title  = {Evaluation of AI Chatbots for Patient-Specific EHR Questions},
  author = {Alaleh Hamidi and Kirk Roberts},
  year   = {2023},
  eprint = {2306.02549},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2306.02549v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2306.02549.svg)](https://codeofpaper.com/paper/2306.02549)

Discussion