Consistency Flow Matching: Defining Straight Flows with Velocity Consistency

Ling Yang, Zixiang Zhang, Zhilong Zhang, Xingchao Liu, Minkai Xu +4 more
7/2/2024
cs.CV

Official code: YangLing0818/consistency_flow_matching (272 stars, MIT, last commit 2025-01-17).

Abstract

Flow matching (FM) is a general framework for defining probability paths via Ordinary Differential Equations (ODEs) to transform between noise and data samples. Recent approaches attempt to straighten these flow trajectories to generate high-quality samples with fewer function evaluations, typically through iterative rectification methods or optimal transport solutions. In this paper, we introduce Consistency Flow Matching (Consistency-FM), a novel FM method that explicitly enforces self-consistency in the velocity field. Consistency-FM directly defines straight flows starting from different times to the same endpoint, imposing constraints on their velocity values. Additionally, we propose a multi-segment training approach for Consistency-FM to enhance expressiveness, achieving a better trade-off between sampling quality and speed. Preliminary experiments demonstrate that our Consistency-FM significantly improves training efficiency by converging 4.4x faster than consistency models and 1.7x faster than rectified flow models while achieving better generation quality. Our code is available at: https://github.com/YangLing0818/consistency_flow_matching

View on arXivView PDF

Code Implementations(1)

MIT

Official Implementation for "Consistency Flow Matching: Defining Straight Flows with Velocity Consistency"

27210C++, CudaJul 2, 20241 years agoMIT
diffusion-modelsflow-matchingimage-generation

Similar Papers

Cite this paper

@article{yang2024consistency,
  title  = {Consistency Flow Matching: Defining Straight Flows with Velocity Consistency},
  author = {Ling Yang and Zixiang Zhang and Zhilong Zhang and Xingchao Liu and Minkai Xu and Wentao Zhang and Chenlin Meng and Stefano Ermon and Bin Cui},
  year   = {2024},
  eprint = {2407.02398},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.02398v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.02398.svg)](https://codeofpaper.com/paper/2407.02398)

Discussion