Understanding Why ChatGPT Outperforms Humans in Visualization Design Advice

Yongsu Ahn, Nam Wook Kim
8/3/2025
cs.HCcs.AI

No confident code implementation found for this paper.

Abstract

This paper investigates why recent generative AI models outperform humans in data visualization knowledge tasks. Through systematic comparative analysis of responses to visualization questions, we find that differences exist between two ChatGPT models and human outputs over rhetorical structure, knowledge breadth, and perceptual quality. Our findings reveal that ChatGPT-4, as a more advanced model, displays a hybrid of characteristics from both humans and ChatGPT-3.5. The two models were generally favored over human responses, while their strengths in coverage and breadth, and emphasis on technical and task-oriented visualization feedback collectively shaped higher overall quality. Based on our findings, we draw implications for advancing user experiences based on the potential of LLMs and human perception over their capabilities, with relevance to broader applications of AI.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Evaluating Graphical Perception with Multimodal LLMs

86% match2025

CHART-6: Human-Centered Evaluation of Data Visualization Understanding in Vision-Language Models

84% match2025

V-RECS, a Low-Cost LLM4VIS Recommender with Explanations, Captioning and Suggestions

83% match1 repo12024

True (VIS) Lies: Analyzing How Generative AI Recognizes Intentionality, Rhetoric, and Misleadingness in Visualization Lies

83% match1 repo22026

VLRMBench: A Comprehensive and Challenging Benchmark for Vision-Language Reward Models

83% match1 repo72025

Human-MME: A Holistic Evaluation Benchmark for Human-Centric Multimodal Large Language Models

82% match1 repo232025

Cite this paper

@article{ahn2025understanding,
  title  = {Understanding Why ChatGPT Outperforms Humans in Visualization Design Advice},
  author = {Yongsu Ahn and Nam Wook Kim},
  year   = {2025},
  eprint = {2508.01547},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2508.01547v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2508.01547.svg)](https://codeofpaper.com/paper/2508.01547)

Discussion