Flow Matching Posterior Sampling: A Training-free Conditional Generation for Flow Matching

Kaiyu Song, Hanjiang Lai, Yan Pan, Kun Yue, Jian yin
11/12/2024
cs.CV

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

Training-free conditional generation based on flow matching aims to leverage pre-trained unconditional flow matching models to perform conditional generation without retraining. Recently, a successful training-free conditional generation approach incorporates conditions via posterior sampling, which relies on the availability of a score function in the unconditional diffusion model. However, flow matching models do not possess an explicit score function, rendering such a strategy inapplicable. Approximate posterior sampling for flow matching has been explored, but it is limited to linear inverse problems. In this paper, we propose Flow Matching-based Posterior Sampling (FMPS) to expand its application scope. We introduce a correction term by steering the velocity field. This correction term can be reformulated to incorporate a surrogate score function, thereby bridging the gap between flow matching models and score-based posterior sampling. Hence, FMPS enables the posterior sampling to be adjusted within the flow matching framework. Further, we propose two practical implementations of the correction mechanism: one aimed at improving generation quality, and the other focused on computational efficiency. Experimental results on diverse conditional generation tasks demonstrate that our method achieves superior generation quality compared to existing state-of-the-art approaches, validating the effectiveness and generality of FMPS.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{song2024flow,
  title  = {Flow Matching Posterior Sampling: A Training-free Conditional Generation for Flow Matching},
  author = {Kaiyu Song and Hanjiang Lai and Yan Pan and Kun Yue and Jian yin},
  year   = {2024},
  eprint = {2411.07625},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2411.07625v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2411.07625.svg)](https://codeofpaper.com/paper/2411.07625)

Discussion