AGI Is Coming... Right After AI Learns to Play Wordle

Sarath Shekkizhar, Romain Cosentino
4/21/2025
cs.AIcs.CV

No confident code implementation found for this paper.

Abstract

This paper investigates multimodal agents, in particular, OpenAI's Computer-User Agent (CUA), trained to control and complete tasks through a standard computer interface, similar to humans. We evaluated the agent's performance on the New York Times Wordle game to elicit model behaviors and identify shortcomings. Our findings revealed a significant discrepancy in the model's ability to recognize colors correctly depending on the context. The model had a $5.36\%$ success rate over several hundred runs across a week of Wordle. Despite the immense enthusiasm surrounding AI agents and their potential to usher in Artificial General Intelligence (AGI), our findings reinforce the fact that even simple tasks present substantial challenges for today's frontier AI models. We conclude with a discussion of the potential underlying causes, implications for future development, and research directions to improve these AI systems.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Can VLMs Play Action Role-Playing Games? Take Black Myth Wukong as a Study Case

85% match2024

Atari-GPT: Benchmarking Multimodal Large Language Models as Low-Level Policies in Atari Games

85% match2024

CogniPlay: a work-in-progress Human-like model for General Game Playing

85% match2025

A Survey on Large Language Model-Based Game Agents

84% match1 repo9202024

Sensi: Learn One Thing at a Time -- Curriculum-Based Test-Time Learning for LLM Game Agents

84% match2026

GUICourse: From General Vision Language Models to Versatile GUI Agents

84% match1 repo1422024

Cite this paper

@article{shekkizhar2025coming,
  title  = {AGI Is Coming... Right After AI Learns to Play Wordle},
  author = {Sarath Shekkizhar and Romain Cosentino},
  year   = {2025},
  eprint = {2504.15434},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2504.15434v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2504.15434.svg)](https://codeofpaper.com/paper/2504.15434)

Discussion