Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind Capabilities

Alex Wilf, Sihyun Shawn Lee, Paul Pu Liang, Louis-Philippe Morency
11/16/2023
cs.AIcs.CL

No official code found. Best implementation: shawnsihyunlee/simulatedtom (25 stars, MIT, last commit 2023-08-16).

Abstract

Human interactions are deeply rooted in the interplay of thoughts, beliefs, and desires made possible by Theory of Mind (ToM): our cognitive ability to understand the mental states of ourselves and others. Although ToM may come naturally to us, emulating it presents a challenge to even the most advanced Large Language Models (LLMs). Recent improvements to LLMs' reasoning capabilities from simple yet effective prompting techniques such as Chain-of-Thought have seen limited applicability to ToM. In this paper, we turn to the prominent cognitive science theory "Simulation Theory" to bridge this gap. We introduce SimToM, a novel two-stage prompting framework inspired by Simulation Theory's notion of perspective-taking. To implement this idea on current ToM benchmarks, SimToM first filters context based on what the character in question knows before answering a question about their mental state. Our approach, which requires no additional training and minimal prompt-tuning, shows substantial improvement over existing methods, and our analysis reveals the importance of perspective-taking to Theory-of-Mind capabilities. Our findings suggest perspective-taking as a promising direction for future research into improving LLMs' ToM capabilities.

View on arXivView PDF

Code Implementations(1)

MIT

Public repository for "Think Twice: Perspective-Taking Improves Large Language Models’ Theory-of-Mind Capabilities".

253HTML, PythonAug 12, 20233 years agoMIT

Cite this paper

@article{wilf2023think,
  title  = {Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind Capabilities},
  author = {Alex Wilf and Sihyun Shawn Lee and Paul Pu Liang and Louis-Philippe Morency},
  year   = {2023},
  eprint = {2311.10227},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2311.10227v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2311.10227.svg)](https://codeofpaper.com/paper/2311.10227)

Discussion