Kreyòl-MT: Building MT for Latin American, Caribbean and Colonial African Creole Languages

Nathaniel R. Robinson, Raj Dabre, Ammon Shurtz, Rasul Dent, Onenamiyi Onesi +12 more
5/8/2024
cs.CL

No official code found. Best implementation: JHU-CLSP/Kreyol-MT (6 stars, MIT, last commit 2024-06-01).

Abstract

A majority of language technologies are tailored for a small number of high-resource languages, while relatively many low-resource languages are neglected. One such group, Creole languages, have long been marginalized in academic study, though their speakers could benefit from machine translation (MT). These languages are predominantly used in much of Latin America, Africa and the Caribbean. We present the largest cumulative dataset to date for Creole language MT, including 14.5M unique Creole sentences with parallel translations -- 11.6M of which we release publicly, and the largest bitexts gathered to date for 41 languages -- the first ever for 21. In addition, we provide MT models supporting all 41 Creole languages in 172 translation directions. Given our diverse dataset, we produce a model for Creole language MT exposed to more genre diversity than ever before, which outperforms a genre-specific Creole MT model on its own benchmark for 26 of 34 translation directions.

View on arXivView PDF

Code Implementations(1)

JHU-CLSP/Kreyol-MTCommunity100%
MIT
60Shell, PythonApr 1, 20242 years agoMIT

Similar Papers

Limitations of Religious Data and the Importance of the Target Domain: Towards Machine Translation for Guinea-Bissau Creole

86% match2025

Building a Functional Machine Translation Corpus for Kpelle

85% match2025

Guylingo: The Republic of Guyana Creole Corpora

83% match1 repo12024

Feriji: A French-Zarma Parallel Corpus, Glossary & Translator

82% match2024

AFRIDOC-MT: Document-level MT Corpus for African Languages

82% match1 repo22025

Toucan: Many-to-Many Translation for 150 African Language Pairs

81% match1 repo62024

Cite this paper

@article{robinson2024kreylmt,
  title  = {Kreyòl-MT: Building MT for Latin American, Caribbean and Colonial African Creole Languages},
  author = {Nathaniel R. Robinson and Raj Dabre and Ammon Shurtz and Rasul Dent and Onenamiyi Onesi and Claire Bizon Monroc and Loïc Grobol and Hasan Muhammad and Ashi Garg and Naome A. Etori and Vijay Murari Tiyyala and Olanrewaju Samuel and Matthew Dean Stutzman and Bismarck Bamfo Odoom and Sanjeev Khudanpur and Stephen D. Richardson and Kenton Murray},
  year   = {2024},
  eprint = {2405.05376},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2405.05376v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2405.05376.svg)](https://codeofpaper.com/paper/2405.05376)

Discussion