Chatbots as Problem Solvers: Playing Twenty Questions with Role Reversals

David Noever, Forrest McKee
1/1/2023
cs.AIcs.CL

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

New chat AI applications like ChatGPT offer an advanced understanding of question context and memory across multi-step tasks, such that experiments can test its deductive reasoning. This paper proposes a multi-role and multi-step challenge, where ChatGPT plays the classic twenty-questions game but innovatively switches roles from the questioner to the answerer. The main empirical result establishes that this generation of chat applications can guess random object names in fewer than twenty questions (average, 12) and correctly guess 94% of the time across sixteen different experimental setups. The research introduces four novel cases where the chatbot fields the questions, asks the questions, both question-answer roles, and finally tries to guess appropriate contextual emotions. One task that humans typically fail but trained chat applications complete involves playing bilingual games of twenty questions (English answers to Spanish questions). Future variations address direct problem-solving using a similar inquisitive format to arrive at novel outcomes deductively, such as patentable inventions or combination thinking. Featured applications of this dialogue format include complex protein designs, neuroscience metadata, and child development educational materials.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{noever2023chatbots,
  title  = {Chatbots as Problem Solvers: Playing Twenty Questions with Role Reversals},
  author = {David Noever and Forrest McKee},
  year   = {2023},
  eprint = {2301.01743},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2301.01743v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2301.01743.svg)](https://codeofpaper.com/paper/2301.01743)

Discussion