SurGen: Text-Guided Diffusion Model for Surgical Video Generation

Joseph Cho, Samuel Schmidgall, Cyril Zakka, Mrudang Mathur, Dhamanpreet Kaur +2 more
8/26/2024
cs.CVcs.AIcs.CL

No confident code implementation found for this paper.

Abstract

Diffusion-based video generation models have made significant strides, producing outputs with improved visual fidelity, temporal coherence, and user control. These advancements hold great promise for improving surgical education by enabling more realistic, diverse, and interactive simulation environments. In this study, we introduce SurGen, a text-guided diffusion model tailored for surgical video synthesis. SurGen produces videos with the highest resolution and longest duration among existing surgical video generation models. We validate the visual and temporal quality of the outputs using standard image and video generation metrics. Additionally, we assess their alignment to the corresponding text prompts through a deep learning classifier trained on surgical data. Our results demonstrate the potential of diffusion models to serve as valuable educational tools for surgical trainees.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{cho2024surgen,
  title  = {SurGen: Text-Guided Diffusion Model for Surgical Video Generation},
  author = {Joseph Cho and Samuel Schmidgall and Cyril Zakka and Mrudang Mathur and Dhamanpreet Kaur and Rohan Shad and William Hiesinger},
  year   = {2024},
  eprint = {2408.14028},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2408.14028v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2408.14028.svg)](https://codeofpaper.com/paper/2408.14028)

Discussion