Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI Agents

Zhaoyuan Huang, Tianjie Ju, Pengzhou Cheng, Zheng Wu, Yansi Li +5 more
9/3/2026
cs.AI

No official code found. Best implementation: serein356/ConflictGuard (0 stars, Apache-2.0, last commit 2026-09-01).

Abstract

Graphical user interface (GUI) agents are increasingly used to execute natural-language instructions on user interfaces, yet real users may issue infeasible instructions due to benign mistakes. A reliable agent should not only know how to act, but also when not to act. In this work, we introduce CONFLICTGUI, a benchmark covering instruction-internal conflicts and instruction-GUI context conflicts to study conflict-aware termination. Our evaluation reveals severe execution-biased overcompliance: agents that perform well on feasible tasks often continue to execute blindly under conflicting instructions. To mitigate this behavior, we propose CONFLICTGUARD, an inference-time framework that aligns an agent's feasibility awareness with its action generation. CONFLICTGUARD contains two coupled components: a feasibility verification protocol that guides the agent to assess instruction logic and GUI-side evidence before acting, and a conditional action modulation mechanism that steers agents from over-compliant execution into termination-oriented behavior. Experiments across five widely-used agents demonstrate that CONFLICTGUARD improves average conflict task success rate significantly, while preserving normal GUI-task performance. These results validate that a lightweight inference-time intervention can substantially boost GUI Agent's competence to identify inappropriate execution scenarios and refrain from unnecessary actions.

View on arXivView PDF

Code Implementations(1)

Apache-2.0

[EMNLP 2026] Code for paper: Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI Agents

00Aug 28, 20261 months agoApache-2.0

Similar Papers

Cite this paper

@article{huang2026agents,
  title  = {Do GUI Agents Know When Not to Act? Enabling Conflict-Aware Termination for Multimodal GUI Agents},
  author = {Zhaoyuan Huang and Tianjie Ju and Pengzhou Cheng and Zheng Wu and Yansi Li and Chuanbiao Song and Jun Lan and Huijia Zhu and Weiqiang Wang and Zhuosheng Zhang},
  year   = {2026},
  eprint = {2609.03438},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2609.03438v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2609.03438.svg)](https://codeofpaper.com/paper/2609.03438)

Discussion