PaperOrchestra: A Multi-Agent Framework for Automated AI Research Paper Writing

Yiwen Song, Yale Song, Tomas Pfister, Jinsung Yoon
4/6/2026
cs.AIcs.LGcs.MA

No official code found. Best implementation: Transconnectome/paperorchestra-data (1 star, last commit 2026-04-12).

Abstract

Synthesizing unstructured research materials into manuscripts is an essential yet under-explored challenge in AI-driven scientific discovery. Existing autonomous writers are rigidly coupled to specific experimental pipelines, and produce superficial literature reviews. We introduce PaperOrchestra, a multi-agent framework for automated AI research paper writing. It flexibly transforms unconstrained pre-writing materials into submission-ready LaTeX manuscripts, including comprehensive literature synthesis and generated visuals, such as plots and conceptual diagrams. To evaluate performance, we present PaperWritingBench, the first standardized benchmark of reverse-engineered raw materials from 200 top-tier AI conference papers, alongside a comprehensive suite of automated evaluators. In side-by-side human evaluations, PaperOrchestra significantly outperforms autonomous baselines, achieving an absolute win rate margin of 50%-68% in literature review quality, and 14%-38% in overall manuscript quality.

View on arXivView PDF

Code Implementations(1)

PaperWritingBench: benchmark data and evaluators for validating the PaperOrchestra pipeline (arXiv 2604.05018). Sister repo to PaperOrchestrator.

10PythonApr 10, 20266 months ago

Similar Papers

Cite this paper

@article{song2026paperorchestra,
  title  = {PaperOrchestra: A Multi-Agent Framework for Automated AI Research Paper Writing},
  author = {Yiwen Song and Yale Song and Tomas Pfister and Jinsung Yoon},
  year   = {2026},
  eprint = {2604.05018},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2604.05018v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2604.05018.svg)](https://codeofpaper.com/paper/2604.05018)

Discussion