ISLTranslate: Dataset for Translating Indian Sign Language

Abhinav Joshi, Susmit Agrawal, Ashutosh Modi
7/11/2023
cs.CLcs.AIcs.LG

Official code: Exploration-Lab/ISLTranslate (24 stars, last commit 2024-08-29).

Abstract

Sign languages are the primary means of communication for many hard-of-hearing people worldwide. Recently, to bridge the communication gap between the hard-of-hearing community and the rest of the population, several sign language translation datasets have been proposed to enable the development of statistical sign language translation systems. However, there is a dearth of sign language resources for the Indian sign language. This resource paper introduces ISLTranslate, a translation dataset for continuous Indian Sign Language (ISL) consisting of 31k ISL-English sentence/phrase pairs. To the best of our knowledge, it is the largest translation dataset for continuous Indian Sign Language. We provide a detailed analysis of the dataset. To validate the performance of existing end-to-end Sign language to spoken language translation systems, we benchmark the created dataset with a transformer-based model for ISL translation.

View on arXivView PDF

Code Implementations(1)

Exploration-Lab/ISLTranslateOfficial100%
241May 26, 20232 years ago

Similar Papers

Bangla Sign Language Translation: Dataset Creation Challenges, Benchmarking and Prospects

88% match2025

Continuous Bangla Sign Language Translation: Mitigating the Expense of Gloss Annotation with the Assistance of Graph

86% match2025

iSign: A Benchmark for Indian Sign Language Processing

86% match2024

Enhanced Sign Language Translation between American Sign Language (ASL) and Indian Sign Language (ISL) Using LLMs

86% match2024

A New Dataset for End-to-End Sign Language Translation: The Greek Elementary School Dataset

85% match2023

iLSU-T: an Open Dataset for Uruguayan Sign Language Translation

85% match1 repo32025

Cite this paper

@article{joshi2023isltranslate,
  title  = {ISLTranslate: Dataset for Translating Indian Sign Language},
  author = {Abhinav Joshi and Susmit Agrawal and Ashutosh Modi},
  year   = {2023},
  eprint = {2307.05440},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2307.05440v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2307.05440.svg)](https://codeofpaper.com/paper/2307.05440)

Discussion