NeSy4VRD: A Multifaceted Resource for Neurosymbolic AI Research using Knowledge Graphs in Visual Relationship Detection

David Herron, Ernesto Jiménez-Ruiz, Giacomo Tarroni, Tillman Weyde
5/22/2023
cs.AI

No official code found. Best implementation: djherron/NeSy4VRD (2 stars, MIT, last commit 2025-09-08).

Abstract

NeSy4VRD is a multifaceted resource designed to support the development of neurosymbolic AI (NeSy) research. NeSy4VRD re-establishes public access to the images of the VRD dataset and couples them with an extensively revised, quality-improved version of the VRD visual relationship annotations. Crucially, NeSy4VRD provides a well-aligned, companion OWL ontology that describes the dataset domain.It comes with open source infrastructure that provides comprehensive support for extensibility of the annotations (which, in turn, facilitates extensibility of the ontology), and open source code for loading the annotations to/from a knowledge graph. We are contributing NeSy4VRD to the computer vision, NeSy and Semantic Web communities to help foster more NeSy research using OWL-based knowledge graphs.

View on arXivView PDF

Code Implementations(1)

djherron/NeSy4VRDCommunity73%
MIT

A resource for neurosymbolic AI research using OWL-based knowledge graphs in visual relationship detection

21Python1 years agoMIT

Similar Papers

NFDI4DSO: Towards a BFO Compliant Ontology for Data Science

80% match1 repo42024

UKnow: A Unified Knowledge Protocol with Multimodal Knowledge Graph Datasets for Reasoning and Vision-Language Pre-Training

80% match2023

Evolution and Efficiency in Neural Architecture Search: Bridging the Gap Between Expert Design and Automated Optimization

79% match2024

On using AI for EEG-based BCI applications: problems, current challenges and future trends

79% match1 repo142025

VisionKG: Unleashing the Power of Visual Datasets via Knowledge Graph

79% match2023

ChainerCV: a Library for Deep Learning in Computer Vision

78% match1 repo1.5k2017

Cite this paper

@article{herron2023nesyvrd,
  title  = {NeSy4VRD: A Multifaceted Resource for Neurosymbolic AI Research using Knowledge Graphs in Visual Relationship Detection},
  author = {David Herron and Ernesto Jiménez-Ruiz and Giacomo Tarroni and Tillman Weyde},
  year   = {2023},
  eprint = {2305.13258},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2305.13258v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2305.13258.svg)](https://codeofpaper.com/paper/2305.13258)

Discussion