JoyAI-Image: Awaking Spatial Intelligence in Unified Multimodal Understanding and Generation

Lin Song, Wenbo Li, Guoqing Ma, Wei Tang, Bo Wang +14 more
5/5/2026
cs.GRcs.AIcs.CL

No confident code implementation found for this paper.

Abstract

We present JoyAI-Image, a unified multimodal foundation model for visual understanding, text-to-image generation, and instruction-guided image editing. JoyAI-Image couples a spatially enhanced Multimodal Large Language Model (MLLM) with a Multimodal Diffusion Transformer (MMDiT), allowing perception and generation to interact through a shared multimodal interface. Around this architecture, we build a scalable training recipe that combines unified instruction tuning, long-text rendering supervision, spatially grounded data, and both general and spatial editing signals. This design gives the model broad multimodal capability while strengthening geometry-aware reasoning and controllable visual synthesis. Experiments across understanding, generation, long-text rendering, and editing benchmarks show that JoyAI-Image achieves state-of-the-art or highly competitive performance. More importantly, the bidirectional loop between enhanced understanding, controllable spatial editing, and novel-view-assisted reasoning enables the model to move beyond general visual competence toward stronger spatial intelligence. These results suggest a promising path for unified visual models in downstream applications such as vision-language-action systems and world models.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{song2026joyaiimage,
  title  = {JoyAI-Image: Awaking Spatial Intelligence in Unified Multimodal Understanding and Generation},
  author = {Lin Song and Wenbo Li and Guoqing Ma and Wei Tang and Bo Wang and Yuan Zhang and Yijun Yang and Yicheng Xiao and Jianhui Liu and Yanbing Zhang and Guohui Zhang and Wenhu Zhang and Hang Xu and Nan Jiang and Xin Han and Haoze Sun and Maoquan Zhang and Haoyang Huang and Nan Duan},
  year   = {2026},
  eprint = {2605.04128},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2605.04128v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2605.04128.svg)](https://codeofpaper.com/paper/2605.04128)

Discussion