CultureTalk-ID: A Multi-Task Dialogue Benchmark for Cultural Commonsense in Indonesian Local Languages

Muhammad Dehan Al Kautsar, Salsabila Pranida, Bilal Elbouardi, Fajri Koto
7/23/2026
cs.CL

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

Culture is lived through conversation, yet existing Indonesian cultural commonsense benchmarks evaluate LLMs on short and isolated prompts, stripping away the dialogic context in which cultural nuances actually surface. We introduce CultureTalk-ID, the first dialogue-based benchmark for cultural commonsense in Indonesian and its local languages, comprising 4,496 culturally grounded dialogues across 11 languages and 13 culturally salient topics, curated through a multi-stage human pipeline with native speakers to ensure authenticity. CultureTalk-ID introduces three complementary tasks, namely dialogue-based multiple-choice cultural commonsense reasoning, culturally faithful machine translation, and language steering, which jointly probe whether LLMs can understand, transfer, and generate culturally grounded language.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

MemeCULT-1K: Benchmarking South Asian Cultural Context and Humor Understanding of Multimodal Models

83% match2026

Almieyar: A Culturally Grounded Benchmark for Multi-Dialect Arabic Speech Recognition

83% match2026

From Words to Worlds: Benchmarking Cross-Cultural Cultural Understanding in Machine Translation

83% match2026

BanglaSocialBench: A Benchmark for Evaluating Sociopragmatic and Cultural Alignment of LLMs in Bangladeshi Social Interaction

83% match2026

GD-COMET: A Geo-Diverse Commonsense Inference Model

83% match2023

VakyArth: Evaluating Pragmatic Competence in LLMs across Indic Languages

83% match2026

Cite this paper

@article{kautsar2026culturetalkid,
  title  = {CultureTalk-ID: A Multi-Task Dialogue Benchmark for Cultural Commonsense in Indonesian Local Languages},
  author = {Muhammad Dehan Al Kautsar and Salsabila Pranida and Bilal Elbouardi and Fajri Koto},
  year   = {2026},
  eprint = {2607.21016},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2607.21016v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2607.21016.svg)](https://codeofpaper.com/paper/2607.21016)

Discussion