AI Models Exceed Individual Human Accuracy in Predicting Everyday Social Norms

Pontus Strimling, Simon Karlsson, Irina Vartanova, Kimmo Eriksson
8/26/2025
cs.AI

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

A fundamental question in cognitive science concerns how social norms are acquired and represented. While humans typically learn norms through embodied social experience, we investigated whether large language models can achieve sophisticated norm understanding through statistical learning alone. Across two studies, we systematically evaluated multiple AI systems' ability to predict human social appropriateness judgments for 555 everyday scenarios by examining how closely they predicted the average judgment compared to each human participant. In Study 1, GPT-4.5's accuracy in predicting the collective judgment on a continuous scale exceeded that of every human participant (100th percentile). Study 2 replicated this, with Gemini 2.5 Pro outperforming 98.7% of humans, GPT-5 97.8%, and Claude Sonnet 4 96.0%. Despite this predictive power, all models showed systematic, correlated errors. These findings demonstrate that sophisticated models of social cognition can emerge from statistical learning over linguistic data alone, challenging strong versions of theories emphasizing the exclusive necessity of embodied experience for cultural competence. The systematic nature of AI limitations across different architectures indicates potential boundaries of pattern-based social understanding, while the models' ability to outperform nearly all individual humans in this predictive task suggests that language serves as a remarkably rich repository for cultural knowledge transmission.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{strimling2025models,
  title  = {AI Models Exceed Individual Human Accuracy in Predicting Everyday Social Norms},
  author = {Pontus Strimling and Simon Karlsson and Irina Vartanova and Kimmo Eriksson},
  year   = {2025},
  eprint = {2508.19004},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2508.19004v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2508.19004.svg)](https://codeofpaper.com/paper/2508.19004)

Discussion