Meaningful Pose-Based Sign Language Evaluation

Zifan Jiang, Colin Leong, Amit Moryossef, Anne Göhring, Annette Rios +6 more
10/8/2025
cs.CL

No confident code implementation found for this paper.

Abstract

We present a comprehensive study on meaningfully evaluating sign language utterances in the form of human skeletal poses. The study covers keypoint distance-based, embedding-based, and back-translation-based metrics. We show tradeoffs between different metrics in different scenarios through automatic meta-evaluation of sign-level retrieval and a human correlation study of text-to-pose translation across different sign languages. Our findings and the open-source pose-evaluation toolkit provide a practical and reproducible way of developing and evaluating sign language translation or generation systems.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{jiang2025meaningful,
  title  = {Meaningful Pose-Based Sign Language Evaluation},
  author = {Zifan Jiang and Colin Leong and Amit Moryossef and Anne Göhring and Annette Rios and Oliver Cory and Maksym Ivashechkin and Neha Tarigopula and Biao Zhang and Rico Sennrich and Sarah Ebling},
  year   = {2025},
  eprint = {2510.07453},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2510.07453v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2510.07453.svg)](https://codeofpaper.com/paper/2510.07453)

Discussion