OmniDiagram: Advancing Unified Diagram Code Generation via Visual Interrogation Reward

Haoyue Yang, Xuanle Zhao, Xuexin Liu, Feibang Jiang, Yao Zhu
4/7/2026
cs.AI

No official code found. Best implementation: Haoyue-Yang/OmniDiagram (12 stars, last commit 2026-04-14).

Abstract

The paradigm of programmable diagram generation is evolving rapidly, playing a crucial role in structured visualization. However, most existing studies are confined to a narrow range of task formulations and language support, constraining their applicability to diverse diagram types. In this work, we propose OmniDiagram, a unified framework that incorporates diverse diagram code languages and task definitions. To address the challenge of aligning code logic with visual fidelity in Reinforcement Learning (RL), we introduce a novel visual feedback strategy named Visual Interrogation Verifies All (\textsc{Viva}). Unlike brittle syntax-based rules or pixel-level matching, \textsc{Viva} rewards the visual structure of rendered diagrams through a generative approach. Specifically, \textsc{Viva} actively generates targeted visual inquiries to scrutinize diagram visual fidelity and provides fine-grained feedback for optimization. This mechanism facilitates a self-evolving training process, effectively obviating the need for manually annotated ground truth code. Furthermore, we construct M3$^2$Diagram, the first large-scale diagram code generation dataset, containing over 196k high-quality instances. Experimental results confirm that the combination of SFT and our \textsc{Viva}-based RL allows OmniDiagram to establish a new state-of-the-art (SOTA) across diagram code generation benchmarks.

View on arXivView PDF

Code Implementations(1)

[ACL'26 Findings] OmniDiagram: Advancing Unified Diagram Code Generation via Visual Interrogation Reward

121Apr 7, 20266 months ago

Similar Papers

Cite this paper

@article{yang2026omnidiagram,
  title  = {OmniDiagram: Advancing Unified Diagram Code Generation via Visual Interrogation Reward},
  author = {Haoyue Yang and Xuanle Zhao and Xuexin Liu and Feibang Jiang and Yao Zhu},
  year   = {2026},
  eprint = {2604.05514},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2604.05514v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2604.05514.svg)](https://codeofpaper.com/paper/2604.05514)

Discussion