FlowInOne:Unifying Multimodal Generation as Image-in, Image-out Flow Matching

Junchao Yi, Rui Zhao, Jiahao Tang, Weixian Lei, Linjie Li +5 more
4/8/2026
cs.CV

No official code found. Best implementation: CSU-JPG/FlowInOne (121 stars, MIT, last commit 2026-04-25).

Abstract

Multimodal generation has long been dominated by text-driven pipelines where language dictates vision but cannot reason or create within it. We challenge this paradigm by asking whether all modalities, including textual descriptions, spatial layouts, and editing instructions, can be unified into a single visual representation. We present FlowInOne, a framework that reformulates multimodal generation as a purely visual flow, converting all inputs into visual prompts and enabling a clean image-in, image-out pipeline governed by a single flow matching model. This vision-centric formulation naturally eliminates cross-modal alignment bottlenecks, noise scheduling, and task-specific architectural branches, unifying text-to-image generation, layout-guided editing, and visual instruction following under one coherent paradigm. To support this, we introduce VisPrompt-5M, a large-scale dataset of 5 million visual prompt pairs spanning diverse tasks including physics-aware force dynamics and trajectory prediction, alongside VP-Bench, a rigorously curated benchmark assessing instruction faithfulness, spatial precision, visual realism, and content consistency. Extensive experiments demonstrate that FlowInOne achieves state-of-the-art performance across all unified generation tasks, surpassing both open-source models and competitive commercial systems, establishing a new foundation for fully vision-centric generative modeling where perception and creation coexist within a single continuous visual space.

View on arXivView PDF

Code Implementations(1)

CSU-JPG/FlowInOneCommunity65%
MIT

Official repository of FlowInOne: Unifying Multimodal Generation as Image-In Image-Out Flow Matching

1215Shell, PythonMar 28, 20265 months agoMIT
flowmatchingimage-generationvision-centric

Similar Papers

Cite this paper

@article{yi2026flowinoneunifying,
  title  = {FlowInOne:Unifying Multimodal Generation as Image-in, Image-out Flow Matching},
  author = {Junchao Yi and Rui Zhao and Jiahao Tang and Weixian Lei and Linjie Li and Qisheng Su and Zhengyuan Yang and Lijuan Wang and Xiaofeng Zhu and Alex Jinpeng Wang},
  year   = {2026},
  eprint = {2604.06757},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2604.06757v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2604.06757.svg)](https://codeofpaper.com/paper/2604.06757)

Discussion