Assessing GPTZero's Accuracy in Identifying AI vs. Human-Written Essays

Selin Dik, Osman Erdem, Mehmet Dik
6/30/2025
cs.AIcs.CL

No confident code implementation found for this paper.

Abstract

As the use of AI tools by students has become more prevalent, instructors have started using AI detection tools like GPTZero and QuillBot to detect AI written text. However, the reliability of these detectors remains uncertain. In our study, we focused mostly on the success rate of GPTZero, the most-used AI detector, in identifying AI-generated texts based on different lengths of randomly submitted essays: short (40-100 word count), medium (100-350 word count), and long (350-800 word count). We gathered a data set consisting of twenty-eight AI-generated papers and fifty human-written papers. With this randomized essay data, papers were individually plugged into GPTZero and measured for percentage of AI generation and confidence. A vast majority of the AI-generated papers were detected accurately (ranging from 91-100% AI believed generation), while the human generated essays fluctuated; there were a handful of false positives. These findings suggest that although GPTZero is effective at detecting purely AI-generated content, its reliability in distinguishing human-authored texts is limited. Educators should therefore exercise caution when relying solely on AI detection tools.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Detecting AI-Generated Text in Educational Content: Leveraging Machine Learning and Explainable AI for Academic Integrity

87% match2025

People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated text

86% match1 repo612025

AI-generated Essays: Characteristics and Implications on Automated Scoring and Academic Integrity

85% match2024

Almost AI, Almost Human: The Challenge of Detecting AI-Polished Writing

85% match1 repo112025

Evaluating the Performance of AI Text Detectors, Few-Shot and Chain-of-Thought Prompting Using DeepSeek Generated Text

85% match2025

Detecting AI-Generated Essays in Writing Assessment: Responsible Use and Generalizability Across LLMs

85% match2026

Cite this paper

@article{dik2025assessing,
  title  = {Assessing GPTZero's Accuracy in Identifying AI vs. Human-Written Essays},
  author = {Selin Dik and Osman Erdem and Mehmet Dik},
  year   = {2025},
  eprint = {2506.23517},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2506.23517v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2506.23517.svg)](https://codeofpaper.com/paper/2506.23517)

Discussion