Improving Machine Translation with Phrase Pair Injection and Corpus Filtering

Akshay Batheja, Pushpak Bhattacharyya
1/19/2023
cs.CLcs.LG

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

In this paper, we show that the combination of Phrase Pair Injection and Corpus Filtering boosts the performance of Neural Machine Translation (NMT) systems. We extract parallel phrases and sentences from the pseudo-parallel corpus and augment it with the parallel corpus to train the NMT models. With the proposed approach, we observe an improvement in the Machine Translation (MT) system for 3 low-resource language pairs, Hindi-Marathi, English-Marathi, and English-Pashto, and 6 translation directions by up to 2.7 BLEU points, on the FLORES test data. These BLEU score improvements are over the models trained using the whole pseudo-parallel corpus augmented with the parallel corpus.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Non-Fluent Synthetic Target-Language Data Improve Neural Machine Translation

86% match1 repo12024

Semi-supervised Neural Machine Translation with Consistency Regularization for Low-Resource Languages

84% match2023

Reconsidering SMT Over NMT for Closely Related Languages: A Case Study of Persian-Hindi Pair

84% match2024

Get away with less: Need of source side data curation to build parallel corpus for low resource Machine Translation

84% match2026

Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation

84% match1 repo302025

Enhancing Neural Machine Translation of Low-Resource Languages: Corpus Development, Human Evaluation and Explainable AI Architectures

84% match2024

Cite this paper

@article{batheja2023improving,
  title  = {Improving Machine Translation with Phrase Pair Injection and Corpus Filtering},
  author = {Akshay Batheja and Pushpak Bhattacharyya},
  year   = {2023},
  eprint = {2301.08008},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2301.08008v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2301.08008.svg)](https://codeofpaper.com/paper/2301.08008)

Discussion