American Sign Language Video to Text Translation

Parsheeta Roy, Ji-Eun Han, Srishti Chouhan, Bhaavanaa Thumu
2/11/2024
cs.CLcs.CV

No confident code implementation found for this paper. 4 possible matches can be shown below.

Abstract

Sign language to text is a crucial technology that can break down communication barriers for individuals with hearing difficulties. We replicate and try to improve on a recently published study. We evaluate models using BLEU and rBLEU metrics to ensure translation quality. During our ablation study, we found that the model's performance is significantly influenced by optimizers, activation functions, and label smoothing. Further research aims to refine visual feature capturing, enhance decoder utilization, and integrate pre-trained decoders for better translation outcomes. Our source code is available to facilitate replication of our results and encourage future research.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 4 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{roy2024american,
  title  = {American Sign Language Video to Text Translation},
  author = {Parsheeta Roy and Ji-Eun Han and Srishti Chouhan and Bhaavanaa Thumu},
  year   = {2024},
  eprint = {2402.07255},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2402.07255v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2402.07255.svg)](https://codeofpaper.com/paper/2402.07255)

Discussion