Segmentation of Maya hieroglyphs through fine-tuned foundation models

FNU Shivam, Megan Leight, Mary Kate Kelly, Claire Davis, Kelsey Clodfelter +3 more
5/26/2024
cs.CV

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

The study of Maya hieroglyphic writing unlocks the rich history of cultural and societal knowledge embedded within this ancient civilization's visual narrative. Artificial Intelligence (AI) offers a novel lens through which we can translate these inscriptions, with the potential to allow non-specialists access to reading these texts and to aid in the decipherment of those hieroglyphs which continue to elude comprehensive interpretation. Toward this, we leverage a foundational model to segment Maya hieroglyphs from an open-source digital library dedicated to Maya artifacts. Despite the initial promise of publicly available foundational segmentation models, their effectiveness in accurately segmenting Maya hieroglyphs was initially limited. Addressing this challenge, our study involved the meticulous curation of image and label pairs with the assistance of experts in Maya art and history, enabling the fine-tuning of these foundational models. This process significantly enhanced model performance, illustrating the potential of fine-tuning approaches and the value of our expanding dataset. We plan to open-source this dataset for encouraging future research, and eventually to help make the hieroglyphic texts legible to a broader community, particularly for Maya heritage community members.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{shivam2024segmentation,
  title  = {Segmentation of Maya hieroglyphs through fine-tuned foundation models},
  author = {FNU Shivam and Megan Leight and Mary Kate Kelly and Claire Davis and Kelsey Clodfelter and Jacob Thrasher and Yenumula Reddy and Prashnna Gyawali},
  year   = {2024},
  eprint = {2405.16426},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2405.16426v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2405.16426.svg)](https://codeofpaper.com/paper/2405.16426)

Discussion