Position: The Real Barrier to LLM Agent Usability is Agentic ROI

Weiwen Liu, Jiarui Qin, Xu Huang, Xingshan Zeng, Yunjia Xi +8 more
5/23/2025
cs.CL

No confident code implementation found for this paper.

Abstract

Large Language Model (LLM) agents represent a promising shift in human-AI interaction, moving beyond passive prompt-response systems to autonomous agents capable of reasoning, planning, and goal-directed action. While LLM agents are technically capable of performing a broad range of tasks, not all of these capabilities translate into meaningful usability. This position paper argues that the central question for LLM agent usability is no longer whether a task can be automated, but whether it delivers sufficient Agentic Return on Investment (Agentic ROI). Agentic ROI reframes evaluation from raw performance to a holistic, utility-driven perspective, guiding when, where, and for whom LLM agents should be deployed. Despite widespread application in high-ROI tasks like coding and scientific research, we identify a critical usability gap in mass-market, everyday applications. To address this, we propose a zigzag developmental trajectory: first scaling up to improve information gain and time savings, then scaling down to reduce cost. We present a strategic roadmap across these phases to make LLM agents truly usable, accessible, and scalable in real-world applications.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{liu2025position,
  title  = {Position: The Real Barrier to LLM Agent Usability is Agentic ROI},
  author = {Weiwen Liu and Jiarui Qin and Xu Huang and Xingshan Zeng and Yunjia Xi and Jianghao Lin and Chuhan Wu and Yasheng Wang and Lifeng Shang and Ruiming Tang and Defu Lian and Yong Yu and Weinan Zhang},
  year   = {2025},
  eprint = {2505.17767},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2505.17767v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2505.17767.svg)](https://codeofpaper.com/paper/2505.17767)

Discussion