IndoRobusta: Towards Robustness Against Diverse Code-Mixed Indonesian Local Languages

Muhammad Farid Adilazuarda, Samuel Cahyawijaya, Genta Indra Winata, Pascale Fung, Ayu Purwarianti
11/21/2023
cs.CL

No confident code implementation found for this paper.

Abstract

Significant progress has been made on Indonesian NLP. Nevertheless, exploration of the code-mixing phenomenon in Indonesian is limited, despite many languages being frequently mixed with Indonesian in daily conversation. In this work, we explore code-mixing in Indonesian with four embedded languages, i.e., English, Sundanese, Javanese, and Malay; and introduce IndoRobusta, a framework to evaluate and improve the code-mixing robustness. Our analysis shows that the pre-training corpus bias affects the model's ability to better handle Indonesian-English code-mixing when compared to other local languages, despite having higher language diversity.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{adilazuarda2023indorobusta,
  title  = {IndoRobusta: Towards Robustness Against Diverse Code-Mixed Indonesian Local Languages},
  author = {Muhammad Farid Adilazuarda and Samuel Cahyawijaya and Genta Indra Winata and Pascale Fung and Ayu Purwarianti},
  year   = {2023},
  eprint = {2311.12405},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2311.12405v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2311.12405.svg)](https://codeofpaper.com/paper/2311.12405)

Discussion