Story Generation from Visual Inputs: Techniques, Related Tasks, and Challenges

Daniel A. P. Oliveira, Eugénio Ribeiro, David Martins de Matos
6/4/2024
cs.CVcs.AI

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

Creating engaging narratives from visual data is crucial for automated digital media consumption, assistive technologies, and interactive entertainment. This survey covers methodologies used in the generation of these narratives, focusing on their principles, strengths, and limitations. The survey also covers tasks related to automatic story generation, such as image and video captioning, and visual question answering, as well as story generation without visual inputs. These tasks share common challenges with visual story generation and have served as inspiration for the techniques used in the field. We analyze the main datasets and evaluation metrics, providing a critical perspective on their limitations.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

VisTopics: A Visual Semantic Unsupervised Approach to Topic Modeling of Video and Image Data

83% match2025

SCO-VIST: Social Interaction Commonsense Knowledge-based Visual Storytelling

82% match2024

Improving Visual Storytelling with Multimodal Large Language Models

80% match2024

StoryBench: A Multifaceted Benchmark for Continuous Story Visualization

80% match1 repo542026

Interactive Narrative Analytics: Bridging Computational Narrative Extraction and Human Sensemaking

80% match2026

Gen4DS: Workshop on Data Storytelling in an Era of Generative AI

80% match2024

Cite this paper

@article{oliveira2024story,
  title  = {Story Generation from Visual Inputs: Techniques, Related Tasks, and Challenges},
  author = {Daniel A. P. Oliveira and Eugénio Ribeiro and David Martins de Matos},
  year   = {2024},
  eprint = {2406.02748},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2406.02748v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2406.02748.svg)](https://codeofpaper.com/paper/2406.02748)

Discussion