How Different AI Chatbots Behave? Benchmarking Large Language Models in Behavioral Economics Games

Yutong Xie, Yiyao Liu, Zhuang Ma, Lin Shi, Xiyuan Wang +3 more
12/16/2024
cs.AIcs.CL

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

The deployment of large language models (LLMs) in diverse applications requires a thorough understanding of their decision-making strategies and behavioral patterns. As a supplement to a recent study on the behavioral Turing test, this paper presents a comprehensive analysis of five leading LLM-based chatbot families as they navigate a series of behavioral economics games. By benchmarking these AI chatbots, we aim to uncover and document both common and distinct behavioral patterns across a range of scenarios. The findings provide valuable insights into the strategic preferences of each LLM, highlighting potential implications for their deployment in critical decision-making roles.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{xie2024different,
  title  = {How Different AI Chatbots Behave? Benchmarking Large Language Models in Behavioral Economics Games},
  author = {Yutong Xie and Yiyao Liu and Zhuang Ma and Lin Shi and Xiyuan Wang and Walter Yuan and Matthew O. Jackson and Qiaozhu Mei},
  year   = {2024},
  eprint = {2412.12362},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2412.12362v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2412.12362.svg)](https://codeofpaper.com/paper/2412.12362)

Discussion