EnterpriseClawBench: Benchmarking Agents from Real Workplace Sessions

Jincheng Zhong, Weizhi Wang, Che Jiang, Kai Tian, Zhenzhao Yuan +3 more
6/22/2026
cs.CLcs.SE

Official code: FrontisAI/EnterpriseClawBench (49 stars, last commit 2026-06-23).

Abstract

Enterprise agents increasingly operate inside workspaces: they read heterogeneous files, invoke tools, and deliver business artifacts. We introduce EnterpriseClawBench, an enterprise agent benchmark constructed from proprietary, real-world agent sessions. Starting from a large archive of workplace sessions, the EnterpriseClawBench produces 852 reproducible tasks, each paired with recovered fixtures, rewritten prompts, role classes, skill subclasses, hard rules, and semantic rubrics. Because the sessions contain internal enterprise content, we do not release the benchmark data; instead, our reusable contribution is the construction and evaluation protocol. On EnterpriseClawBench, the best configuration reaches only 0.663 (Codex with GPT-5.5). These results show that enterprise agent evaluation must report harness--model combinations, artifact delivery, visual quality, cost, runtime, and skill-transfer behavior, rather than collapsing performance into a single score. Code: https://github.com/FrontisAI/EnterpriseClawBench

View on arXivView PDF

Code Implementations(1)

[EMNLP 2026 Industry Track] EnterpriseClawBench: Benchmarking Agents from Real Workplace Sessions

492HTML, PythonJun 22, 20264 months ago

Similar Papers

Cite this paper

@article{zhong2026enterpriseclawbench,
  title  = {EnterpriseClawBench: Benchmarking Agents from Real Workplace Sessions},
  author = {Jincheng Zhong and Weizhi Wang and Che Jiang and Kai Tian and Zhenzhao Yuan and Junlin Yang and Dianqiao Lei and Kaiyan Zhang},
  year   = {2026},
  eprint = {2606.23654},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2606.23654v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2606.23654.svg)](https://codeofpaper.com/paper/2606.23654)

Discussion