FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Models

Vladimir Kulikov, Matan Kleiner, Inbar Huberman-Spiegelglas, Tomer Michaeli
12/11/2024
cs.CVcs.LG

No official code found. Best implementation: fallenshock/FlowEdit (1,021 stars, MIT, last commit 2026-04-24). 1 more below.

Abstract

Editing real images using a pre-trained text-to-image (T2I) diffusion/flow model often involves inverting the image into its corresponding noise map. However, inversion by itself is typically insufficient for obtaining satisfactory results, and therefore many methods additionally intervene in the sampling process. Such methods achieve improved results but are not seamlessly transferable between model architectures. Here, we introduce FlowEdit, a text-based editing method for pre-trained T2I flow models, which is inversion-free, optimization-free and model agnostic. Our method constructs an ODE that directly maps between the source and target distributions (corresponding to the source and target text prompts) and achieves a lower transport cost than the inversion approach. This leads to state-of-the-art results, as we illustrate with Stable Diffusion 3 and FLUX. Code and examples are available on the project's webpage.

View on arXivView PDF

Code Implementations(2)

MIT

Official implementation of the paper: "FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Models"

1,02153PythonNov 22, 20246 months agoMIT
diffusion-modelseditingediting-imagegenerative-modelrectified-flow+2 more

Cog implementation of FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Models

22PythonDec 22, 20241 years ago
coggenerative-aigenerative-apireplicatereplicate-ai+2 more

Similar Papers

Cite this paper

@article{kulikov2024flowedit,
  title  = {FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Models},
  author = {Vladimir Kulikov and Matan Kleiner and Inbar Huberman-Spiegelglas and Tomer Michaeli},
  year   = {2024},
  eprint = {2412.08629},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2412.08629v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2412.08629.svg)](https://codeofpaper.com/paper/2412.08629)

Discussion