The Machine Psychology of Cooperation: Can GPT models operationalise prompts for altruism, cooperation, competitiveness and selfishness in economic games?

Steve Phelps, Yvan I. Russell
5/13/2023
cs.GTcs.AIcs.CY

No official code found. Best implementation: phelps-sg/llm-cooperation (12 stars, MIT, last commit 2024-12-11).

Abstract

We investigated the capability of the GPT-3.5 large language model (LLM) to operationalize natural language descriptions of cooperative, competitive, altruistic, and self-interested behavior in two social dilemmas: the repeated Prisoners Dilemma and the one-shot Dictator Game. Using a within-subject experimental design, we used a prompt to describe the task environment using a similar protocol to that used in experimental psychology studies with human subjects. We tested our research question by manipulating the part of our prompt which was used to create a simulated persona with different cooperative and competitive stances. We then assessed the resulting simulacras' level of cooperation in each social dilemma, taking into account the effect of different partner conditions for the repeated game. Our results provide evidence that LLMs can, to some extent, translate natural language descriptions of different cooperative stances into corresponding descriptions of appropriate task behaviour, particularly in the one-shot game. There is some evidence of behaviour resembling conditional reciprocity for the cooperative simulacra in the repeated game, and for the later version of the model there is evidence of altruistic behaviour. Our study has potential implications for using LLM chatbots in task environments that involve cooperation, e.g. using chatbots as mediators and facilitators in public-goods negotiations.

View on arXivView PDF

Code Implementations(1)

MIT

Code and materials for the paper S. Phelps and Y. I. Russell, Investigating Emergent Goal-Like Behaviour in Large Language Models Using Experimental Economics, working paper, arXiv:2305.07970, May 2023

123R, TeXMay 4, 20231 years agoMIT
ai-alignmentai-safetybehavioral-economicseconomicsexperimental-economics+8 more

Similar Papers

Cite this paper

@article{phelps2023machine,
  title  = {The Machine Psychology of Cooperation: Can GPT models operationalise prompts for altruism, cooperation, competitiveness and selfishness in economic games?},
  author = {Steve Phelps and Yvan I. Russell},
  year   = {2023},
  eprint = {2305.07970},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2305.07970v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2305.07970.svg)](https://codeofpaper.com/paper/2305.07970)

Discussion