The GPT-WritingPrompts Dataset: A Comparative Analysis of Character Portrayal in Short Stories

Xi Yu Huang, Krishnapriya Vishnubhotla, Frank Rudzicz
6/24/2024
cs.CL

Official code: KristinHuangg/gpt-writing-prompts (10 stars, last commit 2024-06-25).

Abstract

The improved generative capabilities of large language models have made them a powerful tool for creative writing and storytelling. It is therefore important to quantitatively understand the nature of generated stories, and how they differ from human storytelling. We augment the Reddit WritingPrompts dataset with short stories generated by GPT-3.5, given the same prompts. We quantify and compare the emotional and descriptive features of storytelling from both generative processes, human and machine, along a set of six dimensions. We find that generated stories differ significantly from human stories along all six dimensions, and that human and machine generations display similar biases when grouped according to the narrative point-of-view and gender of the main protagonist. We release our dataset and code at https://github.com/KristinHuangg/gpt-writing-prompts.

View on arXivView PDF

Code Implementations(1)

KristinHuangg/gpt-writing-promptsOfficial100%
101Shell, PythonApr 8, 20242 years ago

Similar Papers

A Close Reading Approach to Gender Narrative Biases in AI-Generated Stories

83% match2025

What Makes a Good Story and How Can We Measure It? A Comprehensive Survey of Story Evaluation

82% match2024

AI-generated stories favour stability over change: homogeneity and cultural stereotyping in narratives generated by gpt-4o-mini

81% match2025

Are Large Language Models Capable of Generating Human-Level Narratives?

81% match1 repo162024

Evaluating Creative Short Story Generation in Humans and Large Language Models

81% match1 repo52024

BERTtime Stories: Investigating the Role of Synthetic Story Data in Language Pre-training

80% match1 repo32024

Cite this paper

@article{huang2024gptwritingprompts,
  title  = {The GPT-WritingPrompts Dataset: A Comparative Analysis of Character Portrayal in Short Stories},
  author = {Xi Yu Huang and Krishnapriya Vishnubhotla and Frank Rudzicz},
  year   = {2024},
  eprint = {2406.16767},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2406.16767v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2406.16767.svg)](https://codeofpaper.com/paper/2406.16767)

Discussion