OmniVL-Guard Pro: A Tool-Augmented Agent for Omnibus Vision-Language Forensics

Jinjie Shen, Zheng Huang, Yuchen Zhang, Yujiao Wu, Yaxiong Wang +5 more
5/16/2026
cs.CVcs.AI

Official code: shen8424/OmniVL-Guard-Pro (3 stars, last commit 2026-05-19).

Abstract

Existing vision-language forgery detection and grounding methods operate under a closed-world paradigm, assuming verification can be completed by the model alone. However, self-contained MLLMs are constrained by finite parametric knowledge, static training corpora, and limited perceptual resolution, creating a practical ceiling in dynamic open-world forensics -- particularly for real-time event verification requiring external clues and forgery segmentation demanding fine-grained scrutiny of local manipulations. To address these limitations, we shift from scaling up the self-contained model toward reaching beyond it. We propose \textbf{OmniVL-Guard Pro}, a tool-augmented agent that extends unified forensics from closed-world prediction to open-world clues-driven reasoning. OmniVL-Guard Pro integrates a tool environment spanning real-time event search, local cropping and zooming, edge-anomaly screening, face detection, video frame extraction, and SAM3-based segmentation. To generate high-quality tool-reasoning trajectories, we introduce \textbf{Tree-Structured Self-Evolving Tool Trajectory Generation}, which produces diverse trajectories through seed guidance, guider-free self-evolution, and weakly-hinted hard sample synthesis, yielding the Full-Spectrum Tool Reasoning (FSTR) dataset for training. We further propose \textbf{Checker-Guided Agentic Reinforcement Learning} (CGARL), which provides process-level supervision to penalize cases where the answer is correct but the reasoning is distorted. Extensive experiments demonstrate that OmniVL-Guard Pro achieves state-of-the-art performance across various tasks, and exhibits strong zero-shot generalization. The FSTR dataset and code for OmniVL-Guard Pro will be publicly released at https://github.com/shen8424/OmniVL-Guard-Pro.

View on arXivView PDF

Code Implementations(1)

The official code for paper "OmniVL-Guard Pro: A Tool-Augmented Agent for Omnibus Vision-Language Forensics"

30May 16, 20265 months ago

Similar Papers

Cite this paper

@article{shen2026omnivlguard,
  title  = {OmniVL-Guard Pro: A Tool-Augmented Agent for Omnibus Vision-Language Forensics},
  author = {Jinjie Shen and Zheng Huang and Yuchen Zhang and Yujiao Wu and Yaxiong Wang and Lechao Cheng and Shengeng Tang and Tianrui Hui and Nan Pu and Zhun Zhong},
  year   = {2026},
  eprint = {2605.16962},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2605.16962v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2605.16962.svg)](https://codeofpaper.com/paper/2605.16962)

Discussion