Does ChatGPT have Theory of Mind?

Bart Holterman, Kees van Deemter
5/23/2023
cs.CLcs.AI

No confident code implementation found for this paper.

Abstract

Theory of Mind (ToM) is the ability to understand human thinking and decision-making, an ability that plays a crucial role in social interaction between people, including linguistic communication. This paper investigates to what extent recent Large Language Models in the ChatGPT tradition possess ToM. We posed six well-known problems that address biases in human reasoning and decision making to two versions of ChatGPT and we compared the results under a range of prompting strategies. While the results concerning ChatGPT-3 were somewhat inconclusive, ChatGPT-4 was shown to arrive at the correct answers more often than would be expected based on chance, although correct answers were often arrived at on the basis of false assumptions or invalid reasoning.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Theory of Mind in Large Language Models: Examining Performance of 11 State-of-the-Art models vs. Children Aged 7-10 on Advanced Tests

86% match2023

Are LLMs the Master of All Trades? : Exploring Domain-Agnostic Reasoning Skills of LLMs

85% match2023

How FaR Are Large Language Models From Agents with Theory-of-Mind?

85% match2023

Performance of ChatGPT on USMLE: Unlocking the Potential of Large Language Models for AI-Assisted Medical Education

84% match2023

Complementary Advantages of ChatGPTs and Human Readers in Reasoning: Evidence from English Text Reading Comprehension

84% match2023

Boosting Theory-of-Mind Performance in Large Language Models via Prompting

84% match1 repo312023

Cite this paper

@article{holterman2023does,
  title  = {Does ChatGPT have Theory of Mind?},
  author = {Bart Holterman and Kees van Deemter},
  year   = {2023},
  eprint = {2305.14020},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2305.14020v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2305.14020.svg)](https://codeofpaper.com/paper/2305.14020)

Discussion