Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models

Muhammad Maaz, Hanoona Rasheed, Fahad Shahbaz Khan, Salman Khan
11/28/2025
cs.CV

Official code: mbzuai-oryx/Video-R2 (19 stars, last commit 2026-01-21).

Abstract

Reasoning over dynamic visual content remains a central challenge for multimodal large language models. Recent thinking models generate explicit reasoning traces for interpretability; however, their reasoning often appears convincing while being logically inconsistent or weakly grounded in visual evidence. We identify and formalize these issues through two diagnostic metrics: Think Answer Consistency (TAC), which measures the alignment between reasoning and answers, and Video Attention Score (VAS), which captures the extent to which reasoning depends on visual versus textual cues. Analysis across 11 video reasoning benchmarks shows that current models rely heavily on linguistic priors rather than visual content. To address this, we propose a reinforcement learning approach that enhances both temporal precision and reasoning consistency. Our approach combines timestamp aware supervised fine tuning with Group Relative Policy Optimization (GRPO) guided by a novel Temporal Alignment Reward (TAR). This dual step post training stage encourages temporally aligned and causally coherent video reasoning. The resulting model, Video R2, achieves consistently higher TAC, VAS, and accuracy across multiple benchmarks, demonstrating that improvements in temporal alignment and reasoning coherence lead to more accurate and trustworthy video understanding. Code: https://github.com/mbzuai-oryx/Video-R2

View on arXivView PDF

Code Implementations(1)

🔥🔥 (CVPR 2026) Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models

192Shell, PythonNov 27, 20259 months ago

Similar Papers

Cite this paper

@article{maaz2025videor,
  title  = {Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models},
  author = {Muhammad Maaz and Hanoona Rasheed and Fahad Shahbaz Khan and Salman Khan},
  year   = {2025},
  eprint = {2511.23478},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2511.23478v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2511.23478.svg)](https://codeofpaper.com/paper/2511.23478)

Discussion