Constructing and Expanding Low-Resource and Underrepresented Parallel Datasets for Indonesian Local Languages

Joanito Agili Lopo, Radius Tanone
4/1/2024
cs.CL

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

In Indonesia, local languages play an integral role in the culture. However, the available Indonesian language resources still fall into the category of limited data in the Natural Language Processing (NLP) field. This is become problematic when build NLP model for these languages. To address this gap, we introduce Bhinneka Korpus, a multilingual parallel corpus featuring five Indonesian local languages. Our goal is to enhance access and utilization of these resources, extending their reach within the country. We explained in a detail the dataset collection process and associated challenges. Additionally, we experimented with translation task using the IBM Model 1 due to data constraints. The result showed that the performance of each language already shows good indications for further development. Challenges such as lexical variation, smoothing effects, and cross-linguistic variability are discussed. We intend to evaluate the corpus using advanced NLP techniques for low-resource languages, paving the way for multilingual translation models.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

NusaMT-7B: Machine Translation for Low-Resource Indonesian Languages with Large Language Models

85% match2024

Adapting Language Models to Indonesian Local Languages: An Empirical Study of Language Transferability on Zero-Shot Settings

84% match2025

NusaAksara: A Multimodal and Multilingual Benchmark for Preserving Indonesian Indigenous Scripts

83% match2025

Parallel Corpora for Machine Translation in Low-resource Indic Languages: A Comprehensive Review

83% match2025

Building Dialogue Understanding Models for Low-resource Language Indonesian from Scratch

83% match2024

Developing an English-Efik Corpus and Machine Translation System for Digitization Inclusion

83% match2026

Cite this paper

@article{lopo2024constructing,
  title  = {Constructing and Expanding Low-Resource and Underrepresented Parallel Datasets for Indonesian Local Languages},
  author = {Joanito Agili Lopo and Radius Tanone},
  year   = {2024},
  eprint = {2404.01009},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2404.01009v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2404.01009.svg)](https://codeofpaper.com/paper/2404.01009)

Discussion