Sora as a World Model? A Complete Survey on Text-to-Video Generation

Fachrina Dewi Puspitasari, Chaoning Zhang, Joseph Cho, Adnan Haider, Noor Ul Eman +11 more
3/8/2024
cs.AIcs.CV

No confident code implementation found for this paper.

Abstract

The evolution of video generation from text, from animating MNIST to simulating the world with Sora, has progressed at a breakneck speed. Here, we systematically discuss how far text-to-video generation technology supports essential requirements in world modeling. We curate 250+ studies on text-based video synthesis and world modeling. We then observe that recent models increasingly support spatial, action, and strategic intelligences in world modeling through adherence to completeness, consistency, invention, as well as human interaction and control. We conclude that text-to-video generation is adept at world modeling, although homework in several aspects, such as the diversity-consistency trade-offs, remains to be addressed.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{puspitasari2024sora,
  title  = {Sora as a World Model? A Complete Survey on Text-to-Video Generation},
  author = {Fachrina Dewi Puspitasari and Chaoning Zhang and Joseph Cho and Adnan Haider and Noor Ul Eman and Omer Amin and Alexis Mankowski and Muhammad Umair and Jingyao Zheng and Sheng Zheng and Lik-Hang Lee and Caiyan Qin and Tae-Ho Kim and Choong Seon Hong and Yang Yang and Heng Tao Shen},
  year   = {2024},
  eprint = {2403.05131},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2403.05131v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2403.05131.svg)](https://codeofpaper.com/paper/2403.05131)

Discussion