A Multi-way Parallel Named Entity Annotated Corpus for English, Tamil and Sinhala

Surangika Ranathunga, Asanka Ranasinghea, Janaka Shamala, Ayodya Dandeniyaa, Rashmi Galappaththia +1 more
12/3/2024
cs.CL

Official code: suralk/multiNER (1 star, CC0-1.0, last commit 2025-06-06).

Abstract

This paper presents a multi-way parallel English-Tamil-Sinhala corpus annotated with Named Entities (NEs), where Sinhala and Tamil are low-resource languages. Using pre-trained multilingual Language Models (mLMs), we establish new benchmark Named Entity Recognition (NER) results on this dataset for Sinhala and Tamil. We also carry out a detailed investigation on the NER capabilities of different types of mLMs. Finally, we demonstrate the utility of our NER system on a low-resource Neural Machine Translation (NMT) task. Our dataset is publicly released: https://github.com/suralk/multiNER.

View on arXivView PDF

Code Implementations(1)

suralk/multiNEROfficial100%
CC0-1.0

Multiway parallel Named Entity annotated corpus for English-Sinhala-Tamil

10Dec 2, 20241 years agoCC0-1.0

Similar Papers

Fine-tuning Pre-trained Named Entity Recognition Models For Indian Languages

91% match2024

TriNER: A Series of Named Entity Recognition Models For Hindi, Bengali & Marathi

88% match2025

Enhancing Low Resource NER Using Assisting Language And Transfer Learning

87% match2023

ANCHOLIK-NER: A Benchmark Dataset for Bangla Regional Named Entity Recognition

86% match1 repo12025

Bridging the Gap: Transfer Learning from English PLMs to Malaysian English

85% match2024

Long Range Named Entity Recognition for Marathi Documents

85% match2024

Cite this paper

@article{ranathunga2024multiway,
  title  = {A Multi-way Parallel Named Entity Annotated Corpus for English, Tamil and Sinhala},
  author = {Surangika Ranathunga and Asanka Ranasinghea and Janaka Shamala and Ayodya Dandeniyaa and Rashmi Galappaththia and Malithi Samaraweeraa},
  year   = {2024},
  eprint = {2412.02056},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2412.02056v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2412.02056.svg)](https://codeofpaper.com/paper/2412.02056)

Discussion