Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training

Zhihong Pan, Jiyuan He, Kai Zhang, Yupeng Han, Ze Liu +3 more
7/30/2026
cs.AI

No confident code implementation found for this paper.

Abstract

Training terminal agents at scale requires diverse, verifiable terminal tasks and high-quality interaction trajectories, yet acquiring such data remains a significant challenge. Existing synthesis methods face two key limitations: (1) weak reliability caused by the disconnect between task generation and real execution, and (2) limited diversity and scalability due to dependence on existing repositories. We propose Meta-Task, a framework that redefines terminal task synthesis as a Terminal-Bench-format task itself: an agent operates within a real container environment to iteratively generate, execute, and verify tasks, so that synthesized components are checked for internal consistency and executability within the generation loop itself. Building upon this, we decouple the target task requirements along multiple dimensions, introduce a multi-phase mechanism that dynamically designs novel task specifications before producing the actual tasks, and incorporate optional external material support to enhance diversity and realism. We additionally apply LLM-as-Judge filtering to ensure the quality of the final training data. Experiments on Terminal-Bench 2.0 show that fine-tuning on only 3,221 Meta-Task synthesized trajectories achieves 22.5% and 31.8% Avg Pass@1 for Qwen3-14B and Qwen3-32B respectively, outperforming concurrent approaches with significantly less training data.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{pan2026metatask,
  title  = {Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training},
  author = {Zhihong Pan and Jiyuan He and Kai Zhang and Yupeng Han and Ze Liu and Yuze Zhao and Yongcong Ye and Zhaohua Yang},
  year   = {2026},
  eprint = {2607.27929},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2607.27929v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2607.27929.svg)](https://codeofpaper.com/paper/2607.27929)

Discussion