Beyond Translation: LLM-Based Data Generation for Multilingual Fact-Checking

Yi-Ling Chung, Aurora Cobo, Pablo Serna
2/21/2025
cs.CLcs.AIcs.CY

No official code found. Best implementation: Genaios/MultiSynFact (5 stars, last commit 2025-02-24).

Abstract

Robust automatic fact-checking systems have the potential to combat online misinformation at scale. However, most existing research primarily focuses on English. In this paper, we introduce MultiSynFact, the first large-scale multilingual fact-checking dataset containing 2.2M claim-source pairs designed to support Spanish, German, English, and other low-resource languages. Our dataset generation pipeline leverages Large Language Models (LLMs), integrating external knowledge from Wikipedia and incorporating rigorous claim validation steps to ensure data quality. We evaluate the effectiveness of MultiSynFact across multiple models and experimental settings. Additionally, we open-source a user-friendly framework to facilitate further research in multilingual fact-checking and dataset generation.

View on arXivView PDF

Code Implementations(1)

Genaios/MultiSynFactCommunity100%

A modular and extensible Python toolkit designed to facilitate the creation of high-quality multilingual fact-cheking datasets using LLMs

51Shell, PythonFeb 10, 20251 years agoNOASSERTION

Similar Papers

Large Language Models for Multilingual Previously Fact-Checked Claim Detection

90% match1 repo42025

Multi-FAct: Assessing Factuality of Multilingual LLMs using FActScore

89% match2024

When Scale Meets Diversity: Evaluating Language Models on Fine-Grained Multilingual Claim Verification

89% match1 repo72025

Multilingual, Multimodal Pipeline for Creating Authentic and Structured Fact-Checked Claim Dataset

89% match2026

Investigating Language and Retrieval Bias in Multilingual Previously Fact-Checked Claim Detection

87% match1 repo42025

A Comparative Study of Translation Bias and Accuracy in Multilingual Large Language Models for Cross-Language Claim Verification

87% match1 repo12024

Cite this paper

@article{chung2025beyond,
  title  = {Beyond Translation: LLM-Based Data Generation for Multilingual Fact-Checking},
  author = {Yi-Ling Chung and Aurora Cobo and Pablo Serna},
  year   = {2025},
  eprint = {2502.15419},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2502.15419v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2502.15419.svg)](https://codeofpaper.com/paper/2502.15419)

Discussion