Optimal Flow Matching: Learning Straight Trajectories in Just One Step

Nikita Kornilov, Petr Mokrov, Alexander Gasnikov, Alexander Korotin
3/19/2024
stat.MLcs.LG

No official code found. Best implementation: Jhomanik/Optimal-Flow-Matching (114 stars, last commit 2024-12-19).

Abstract

Over the several recent years, there has been a boom in development of Flow Matching (FM) methods for generative modeling. One intriguing property pursued by the community is the ability to learn flows with straight trajectories which realize the Optimal Transport (OT) displacements. Straightness is crucial for the fast integration (inference) of the learned flow's paths. Unfortunately, most existing flow straightening methods are based on non-trivial iterative FM procedures which accumulate the error during training or exploit heuristics based on minibatch OT. To address these issues, we develop and theoretically justify the novel \textbf{Optimal Flow Matching} (OFM) approach which allows recovering the straight OT displacement for the quadratic transport in just one FM step. The main idea of our approach is the employment of vector field for FM which are parameterized by convex functions.

View on arXivView PDF

Code Implementations(1)

The official repository for the paper "Optimal Flow Matching: Learning Straight Trajectories in Just One Step" (NeurIPS 2024)

1144Python, Jupyter NotebookOct 8, 20241 years ago
flow-matchinggenerative-ainips-2024optimal-transport

Similar Papers

Cite this paper

@article{kornilov2024optimal,
  title  = {Optimal Flow Matching: Learning Straight Trajectories in Just One Step},
  author = {Nikita Kornilov and Petr Mokrov and Alexander Gasnikov and Alexander Korotin},
  year   = {2024},
  eprint = {2403.13117},
  archivePrefix = {arXiv},
  doi    = {10.48550/arXiv.2403.13117},
  url    = {http://arxiv.org/abs/2403.13117v3},
  journal = {NEURIPS 2024 2024}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2403.13117.svg)](https://codeofpaper.com/paper/2403.13117)

Discussion