TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environments

Zhangchen Xu, Adriana Meza Soria, Shawn Tan, Anurag Roy, Ashish Sunil Agrawal +2 more
10/1/2025
cs.LGcs.AIcs.CL

No official code found. Best implementation: TheAgentArk/Toucan (267 stars, MIT, last commit 2025-12-16).

Abstract

Large Language Model (LLM) agents are rapidly emerging as powerful systems for automating tasks across domains. Yet progress in the open-source community is constrained by the lack of high quality permissively licensed tool-agentic training data. Existing datasets are often limited in diversity, realism, and complexity, particularly regarding multi-tool and multi-turn interactions. To address this gap, we introduce Toucan, the largest publicly available tool-agentic dataset to date, containing 1.5 million trajectories synthesized from nearly 500 real-world Model Context Protocols (MCPs). Unlike prior work, Toucan leverages authentic MCP environments to generate diverse, realistic, and challenging tasks with trajectories involving real tool execution. Our pipeline first produces a broad spectrum of tool-use queries using five distinct models, applies model-based quality filtering, and then generates agentic trajectories with three teacher models using two agentic frameworks. Rigorous rule-based and model-based validation ensures high-quality outputs. We also introduce three extension mechanisms to further diversify tasks and simulate multi-turn conversations. Models fine-tuned on Toucan outperform larger closed-source counterparts on the BFCL V3 benchmark and push the Pareto frontier forward on MCP-Universe Bench.

View on arXivView PDF

Code Implementations(1)

TheAgentArk/ToucanCommunity61%
MIT

Official repo of Toucan: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environments

26718CSS, HTMLSep 30, 202510 months agoMIT

Similar Papers

Cite this paper

@article{xu2025toucan,
  title  = {TOUCAN: Synthesizing 1.5M Tool-Agentic Data from Real-World MCP Environments},
  author = {Zhangchen Xu and Adriana Meza Soria and Shawn Tan and Anurag Roy and Ashish Sunil Agrawal and Radha Poovendran and Rameswar Panda},
  year   = {2025},
  eprint = {2510.01179},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2510.01179v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2510.01179.svg)](https://codeofpaper.com/paper/2510.01179)

Discussion