A Morphologically-Aware Dictionary-based Data Augmentation Technique for Machine Translation of Under-Represented Languages

Md Mahfuz Ibn Alam, Sina Ahmadi, Antonios Anastasopoulos
2/2/2024
cs.CL

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

The availability of parallel texts is crucial to the performance of machine translation models. However, most of the world's languages face the predominant challenge of data scarcity. In this paper, we propose strategies to synthesize parallel data relying on morpho-syntactic information and using bilingual lexicons along with a small amount of seed parallel data. Our methodology adheres to a realistic scenario backed by the small parallel seed data. It is linguistically informed, as it aims to create augmented data that is more likely to be grammatically correct. We analyze how our synthetic data can be combined with raw parallel data and demonstrate a consistent improvement in performance in our experiments on 14 languages (28 English <-> X pairs) ranging from well- to very low-resource ones. Our method leads to improvements even when using only five seed sentences and a bilingual lexicon.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{alam2024morphologicallyaware,
  title  = {A Morphologically-Aware Dictionary-based Data Augmentation Technique for Machine Translation of Under-Represented Languages},
  author = {Md Mahfuz Ibn Alam and Sina Ahmadi and Antonios Anastasopoulos},
  year   = {2024},
  eprint = {2402.01939},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2402.01939v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2402.01939.svg)](https://codeofpaper.com/paper/2402.01939)

Discussion