Exploring Spatial Intelligence from a Generative Perspective

Muzhi Zhu, Shunyao Jiang, Huanyi Zheng, Zekai Luo, Hao Zhong +7 more
4/22/2026
cs.CV

No official code found. Best implementation: aim-uofa/GSI-Bench (32 stars, last commit 2026-04-23).

Abstract

Spatial intelligence is essential for multimodal large language models, yet current benchmarks largely assess it only from an understanding perspective. We ask whether modern generative or unified multimodal models also possess generative spatial intelligence (GSI), the ability to respect and manipulate 3D spatial constraints during image generation, and whether such capability can be measured or improved. We introduce GSI-Bench, the first benchmark designed to quantify GSI through spatially grounded image editing. It consists of two complementary components: GSI-Real, a high-quality real-world dataset built via a 3D-prior-guided generation and filtering pipeline, and GSI-Syn, a large-scale synthetic benchmark with controllable spatial operations and fully automated labeling. Together with a unified evaluation protocol, GSI-Bench enables scalable, model-agnostic assessment of spatial compliance and editing fidelity. Experiments show that fine-tuning unified multimodal models on GSI-Syn yields substantial gains on both synthetic and real tasks and, strikingly, also improves downstream spatial understanding. This provides the first clear evidence that generative training can tangibly strengthen spatial reasoning, establishing a new pathway for advancing spatial intelligence in multimodal models.

View on arXivView PDF

Code Implementations(1)

aim-uofa/GSI-BenchCommunity73%

[CVPR2026] Exploring Spatial Intelligence from a Generative Perspective

321Shell, Python6 months agoNOASSERTION
spatial-intelligence

Similar Papers

Cite this paper

@article{zhu2026exploring,
  title  = {Exploring Spatial Intelligence from a Generative Perspective},
  author = {Muzhi Zhu and Shunyao Jiang and Huanyi Zheng and Zekai Luo and Hao Zhong and Anzhou Li and Kaijun Wang and Jintao Rong and Yang Liu and Hao Chen and Tao Lin and Chunhua Shen},
  year   = {2026},
  eprint = {2604.20570},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2604.20570v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2604.20570.svg)](https://codeofpaper.com/paper/2604.20570)

Discussion