Comprehending Semantic Types in JSON Data with Graph Neural Networks

Shuang Wei, Michael J. Mior
7/24/2023
cs.DBcs.AI

No confident code implementation found for this paper.

Abstract

Semantic types are a more powerful and detailed way of describing data than atomic types such as strings or integers. They establish connections between columns and concepts from the real world, providing more nuanced and fine-grained information that can be useful for tasks such as automated data cleaning, schema matching, and data discovery. Existing deep learning models trained on large text corpora have been successful at performing single-column semantic type prediction for relational data. However, in this work, we propose an extension of the semantic type prediction problem to JSON data, labeling the types based on JSON Paths. Similar to columns in relational data, JSON Path is a query language that enables the navigation of complex JSON data structures by specifying the location and content of the elements. We use a graph neural network to comprehend the structural information within collections of JSON documents. Our model outperforms a state-of-the-art existing model in several cases. These results demonstrate the ability of our model to understand complex JSON data and its potential usage for JSON-related data processing tasks.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{wei2023comprehending,
  title  = {Comprehending Semantic Types in JSON Data with Graph Neural Networks},
  author = {Shuang Wei and Michael J. Mior},
  year   = {2023},
  eprint = {2307.12807},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2307.12807v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2307.12807.svg)](https://codeofpaper.com/paper/2307.12807)

Discussion