The eBible Corpus: Data and Model Benchmarks for Bible Translation for Low-Resource Languages

Vesa Akerman, David Baines, Damien Daspit, Ulf Hermjakob, Taeho Jang +5 more
4/19/2023
cs.CLcs.AI

No official code found. Best implementation: BibleNLP/ebible-experiments (6 stars, MIT, last commit 2023-05-03).

Abstract

Efficiently and accurately translating a corpus into a low-resource language remains a challenge, regardless of the strategies employed, whether manual, automated, or a combination of the two. Many Christian organizations are dedicated to the task of translating the Holy Bible into languages that lack a modern translation. Bible translation (BT) work is currently underway for over 3000 extremely low resource languages. We introduce the eBible corpus: a dataset containing 1009 translations of portions of the Bible with data in 833 different languages across 75 language families. In addition to a BT benchmarking dataset, we introduce model performance benchmarks built on the No Language Left Behind (NLLB) neural machine translation (NMT) models. Finally, we describe several problems specific to the domain of BT and consider how the established data and model benchmarks might be used for future translation efforts. For a BT task trained with NLLB, Austronesian and Trans-New Guinea language families achieve 35.1 and 31.6 BLEU scores respectively, which spurs future innovations for NMT for low-resource languages in Papua New Guinea.

View on arXivView PDF

Code Implementations(1)

BibleNLP/ebible-experimentsCommunity100%
MIT

Baseline experiments run on the ebible dataset.

60PythonFeb 10, 20233 years agoMIT

Similar Papers

Developing an English-Efik Corpus and Machine Translation System for Digitization Inclusion

92% match2026

First Attempt at Building Parallel Corpora for Machine Translation of Northeast India's Very Low-Resource Languages

91% match2023

BhashaSetu: A Data-Centric Approach to Low-Resource Machine Translation

90% match2026

Machine Translation for Ge'ez Language

89% match2023

Replicable Benchmarking of Neural Machine Translation (NMT) on Low-Resource Local Languages in Indonesia

89% match2023

Parallel Corpus for Indigenous Language Translation: Spanish-Mazatec and Spanish-Mixtec

89% match2023

Cite this paper

@article{akerman2023ebible,
  title  = {The eBible Corpus: Data and Model Benchmarks for Bible Translation for Low-Resource Languages},
  author = {Vesa Akerman and David Baines and Damien Daspit and Ulf Hermjakob and Taeho Jang and Colin Leong and Michael Martin and Joel Mathew and Jonathan Robie and Marcus Schwarting},
  year   = {2023},
  eprint = {2304.09919},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2304.09919v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2304.09919.svg)](https://codeofpaper.com/paper/2304.09919)

Discussion