KazParC: Kazakh Parallel Corpus for Machine Translation

Rustem Yeshpanov, Alina Polonskaya, Huseyin Atakan Varol
3/28/2024
cs.CL

No official code found. Best implementation: IS2AI/KazParC (17 stars, last commit 2024-03-29).

Abstract

We introduce KazParC, a parallel corpus designed for machine translation across Kazakh, English, Russian, and Turkish. The first and largest publicly available corpus of its kind, KazParC contains a collection of 371,902 parallel sentences covering different domains and developed with the assistance of human translators. Our research efforts also extend to the development of a neural machine translation model nicknamed Tilmash. Remarkably, the performance of Tilmash is on par with, and in certain instances, surpasses that of industry giants, such as Google Translate and Yandex Translate, as measured by standard evaluation metrics, such as BLEU and chrF. Both KazParC and Tilmash are openly available for download under the Creative Commons Attribution 4.0 International License (CC BY 4.0) through our GitHub repository.

View on arXivView PDF

Code Implementations(1)

IS2AI/KazParCCommunity100%

An open-source parallel corpus for machine translation across Kazakh, English, Russian, and Turkish

171Python, Jupyter NotebookOct 27, 20232 years ago

Similar Papers

Enhancing Language Learning through Technology: Introducing a New English-Azerbaijani (Arabic Script) Parallel Corpus

85% match2024

Open Language Data Initiative: Advancing Low-Resource Machine Translation for Karakalpak

84% match2024

Neural machine translation system for Lezgian, Russian and Azerbaijani languages

83% match1 repo2024

KazMMLU: Evaluating Language Models on Kazakh, Russian, and Regional Knowledge of Kazakhstan

82% match2025

No One-Size-Fits-All: Building Systems For Translation to Bashkir, Kazakh, Kyrgyz, Tatar and Chuvash Using Synthetic And Original Data

82% match2026

Developing an English-Efik Corpus and Machine Translation System for Digitization Inclusion

80% match2026

Cite this paper

@article{yeshpanov2024kazparc,
  title  = {KazParC: Kazakh Parallel Corpus for Machine Translation},
  author = {Rustem Yeshpanov and Alina Polonskaya and Huseyin Atakan Varol},
  year   = {2024},
  eprint = {2403.19399},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2403.19399v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2403.19399.svg)](https://codeofpaper.com/paper/2403.19399)

Discussion