Text and Audio Simplification: Human vs. ChatGPT

Gondy Leroy, David Kauchak, Philip Harber, Ankit Pal, Akash Shukla
4/29/2024
cs.CLcs.AI

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

Text and audio simplification to increase information comprehension are important in healthcare. With the introduction of ChatGPT, an evaluation of its simplification performance is needed. We provide a systematic comparison of human and ChatGPT simplified texts using fourteen metrics indicative of text difficulty. We briefly introduce our online editor where these simplification tools, including ChatGPT, are available. We scored twelve corpora using our metrics: six text, one audio, and five ChatGPT simplified corpora. We then compare these corpora with texts simplified and verified in a prior user study. Finally, a medical domain expert evaluated these texts and five, new ChatGPT simplified versions. We found that simple corpora show higher similarity with the human simplified texts. ChatGPT simplification moves metrics in the right direction. The medical domain expert evaluation showed a preference for the ChatGPT style, but the text itself was rated lower for content retention.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{leroy2024text,
  title  = {Text and Audio Simplification: Human vs. ChatGPT},
  author = {Gondy Leroy and David Kauchak and Philip Harber and Ankit Pal and Akash Shukla},
  year   = {2024},
  eprint = {2405.01592},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2405.01592v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2405.01592.svg)](https://codeofpaper.com/paper/2405.01592)

Discussion