IndoToD: A Multi-Domain Indonesian Benchmark For End-to-End Task-Oriented Dialogue Systems

Muhammad Dehan Al Kautsar, Rahmah Khoirussyifa' Nurdini, Samuel Cahyawijaya, Genta Indra Winata, Ayu Purwarianti
11/2/2023
cs.CLcs.AI

No official code found. Best implementation: dehanalkautsar/IndoToD (2 stars, Apache-2.0, last commit 2024-06-10).

Abstract

Task-oriented dialogue (ToD) systems have been mostly created for high-resource languages, such as English and Chinese. However, there is a need to develop ToD systems for other regional or local languages to broaden their ability to comprehend the dialogue contexts in various languages. This paper introduces IndoToD, an end-to-end multi domain ToD benchmark in Indonesian. We extend two English ToD datasets to Indonesian, comprising four different domains by delexicalization to efficiently reduce the size of annotations. To ensure a high-quality data collection, we hire native speakers to manually translate the dialogues. Along with the original English datasets, these new Indonesian datasets serve as an effective benchmark for evaluating Indonesian and English ToD systems as well as exploring the potential benefits of cross-lingual and bilingual transfer learning approaches.

View on arXivView PDF

Code Implementations(1)

dehanalkautsar/IndoToDCommunity100%
Apache-2.0

IndoToD: A Multi-Domain Indonesian Benchmark For End-to-End Task-Oriented Dialogue Systems

20Oct 17, 20232 years agoApache-2.0

Similar Papers

Multi3WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systems

87% match1 repo172023

X-RiSAWOZ: High-Quality End-to-End Multilingual Dialogue Datasets and Few-shot Agents

86% match1 repo192023

xDial-Eval: A Multilingual Open-Domain Dialogue Evaluation Benchmark

85% match1 repo72023

Towards Multilingual Automatic Dialogue Evaluation

85% match1 repo42023

Prompt Learning to Mitigate Catastrophic Forgetting in Cross-lingual Transfer for Open-domain Dialogue Generation

85% match2023

DialogStudio: Towards Richest and Most Diverse Unified Dataset Collection for Conversational AI

84% match1 repo5272023

Cite this paper

@article{kautsar2023indotod,
  title  = {IndoToD: A Multi-Domain Indonesian Benchmark For End-to-End Task-Oriented Dialogue Systems},
  author = {Muhammad Dehan Al Kautsar and Rahmah Khoirussyifa' Nurdini and Samuel Cahyawijaya and Genta Indra Winata and Ayu Purwarianti},
  year   = {2023},
  eprint = {2311.00958},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2311.00958v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2311.00958.svg)](https://codeofpaper.com/paper/2311.00958)

Discussion