Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learning

Yuhong Liu, Beichen Zhang, Yuhang Zang, Yuhang Cao, Long Xing +4 more
10/31/2025
cs.CVcs.AI

No official code found. Best implementation: InternLM/Spatial-SSRL (133 stars, Apache-2.0, last commit 2026-04-07).

Abstract

Spatial understanding remains a weakness of Large Vision-Language Models (LVLMs). Existing supervised fine-tuning (SFT) and recent reinforcement learning with verifiable rewards (RLVR) pipelines depend on costly supervision, specialized tools, or constrained environments that limit scale. We introduce Spatial-SSRL, a self-supervised RL paradigm that derives verifiable signals directly from ordinary RGB or RGB-D images. Spatial-SSRL automatically formulates five pretext tasks that capture 2D and 3D spatial structure: shuffled patch reordering, flipped patch recognition, cropped patch inpainting, regional depth ordering, and relative 3D position prediction. These tasks provide ground-truth answers that are easy to verify and require no human or LVLM annotation. Training on our tasks substantially improves spatial reasoning while preserving general visual capabilities. On seven spatial understanding benchmarks in both image and video settings, Spatial-SSRL delivers average accuracy gains of 4.63% (3B) and 3.89% (7B) over the Qwen2.5-VL baselines. Our results show that simple, intrinsic supervision enables RLVR at scale and provides a practical route to stronger spatial intelligence in LVLMs.

View on arXivView PDF

Code Implementations(1)

Apache-2.0

[CVPR 2026] Official release of "Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learning"

1334Jinja, ShellOct 29, 20256 months agoApache-2.0
3d-understandinglarge-language-modelslarge-vision-language-modelsllmspatial-understanding+2 more

Similar Papers

Cite this paper

@article{liu2025spatialssrl,
  title  = {Spatial-SSRL: Enhancing Spatial Understanding via Self-Supervised Reinforcement Learning},
  author = {Yuhong Liu and Beichen Zhang and Yuhang Zang and Yuhang Cao and Long Xing and Xiaoyi Dong and Haodong Duan and Dahua Lin and Jiaqi Wang},
  year   = {2025},
  eprint = {2510.27606},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2510.27606v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2510.27606.svg)](https://codeofpaper.com/paper/2510.27606)

Discussion