How Smart Is Your GUI Agent? A Framework for the Future of Software Interaction

Sidong Feng, Chunyang Chen
2/12/2026
cs.SEcs.AIcs.CV

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

GUI agents are rapidly becoming a new interaction to software, allowing people to navigate web, desktop and mobile rather than execute them click by click. Yet ``agent'' is described with radically different degrees of autonomy, obscuring capability, responsibility and risk. We call for conceptual clarity through GUI Agent Autonomy Levels (GAL), a six-level framework that makes autonomy explicit and helps benchmark progress toward trustworthy software interaction.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

A Survey on (M)LLM-Based GUI Agents

84% match2025

Agent S: An Open Agentic Framework that Uses Computers Like a Human

82% match1 repo12.2k2024

Towards Trustworthy GUI Agents: A Survey

82% match1 repo92025

Computer-Use Agents as Judges for Generative User Interface

81% match1 repo452025

UI-TARS: Pioneering Automated GUI Interaction with Native Agents

81% match1 repo11.6k2025

The Dawn of GUI Agent: A Preliminary Case Study with Claude 3.5 Computer Use

81% match1 repo2.0k2024

Cite this paper

@article{feng2026smart,
  title  = {How Smart Is Your GUI Agent? A Framework for the Future of Software Interaction},
  author = {Sidong Feng and Chunyang Chen},
  year   = {2026},
  eprint = {2602.11514},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2602.11514v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2602.11514.svg)](https://codeofpaper.com/paper/2602.11514)

Discussion