A Tulu Resource for Machine Translation

Manu Narayanan, Noëmi Aepli
3/28/2024
cs.CL

Official code: manunarayanan/Tulu-NMT (8 stars, GPL-3.0, last commit 2024-05-20).

Abstract

We present the first parallel dataset for English-Tulu translation. Tulu, classified within the South Dravidian linguistic family branch, is predominantly spoken by approximately 2.5 million individuals in southwestern India. Our dataset is constructed by integrating human translations into the multilingual machine translation resource FLORES-200. Furthermore, we use this dataset for evaluation purposes in developing our English-Tulu machine translation model. For the model's training, we leverage resources available for related South Dravidian languages. We adopt a transfer learning approach that exploits similarities between high-resource and low-resource languages. This method enables the training of a machine translation system even in the absence of parallel data between the source and target language, thereby overcoming a significant obstacle in machine translation development for low-resource languages. Our English-Tulu system, trained without using parallel English-Tulu data, outperforms Google Translate by 19 BLEU points (in September 2023). The dataset and code are available here: https://github.com/manunarayanan/Tulu-NMT.

View on arXivView PDF

Code Implementations(1)

GPL-3.0

A Tulu-English translation model using a transfer learning approach with Kannada as a related high-resource language.

81Shell, PythonMar 24, 20242 years agoGPL-3.0

Similar Papers

Cite this paper

@article{narayanan2024tulu,
  title  = {A Tulu Resource for Machine Translation},
  author = {Manu Narayanan and Noëmi Aepli},
  year   = {2024},
  eprint = {2403.19142},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2403.19142v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2403.19142.svg)](https://codeofpaper.com/paper/2403.19142)

Discussion