Large Language Models for Multilingual Previously Fact-Checked Claim Detection

Ivan Vykopal, Matúš Pikuliak, Simon Ostermann, Tatiana Anikina, Michal Gregor +1 more
3/4/2025
cs.CL

No official code found. Best implementation: kinit-sk/llms-claim-matching (4 stars, last commit 2025-05-30).

Abstract

In our era of widespread false information, human fact-checkers often face the challenge of duplicating efforts when verifying claims that may have already been addressed in other countries or languages. As false information transcends linguistic boundaries, the ability to automatically detect previously fact-checked claims across languages has become an increasingly important task. This paper presents the first comprehensive evaluation of large language models (LLMs) for multilingual previously fact-checked claim detection. We assess seven LLMs across 20 languages in both monolingual and cross-lingual settings. Our results show that while LLMs perform well for high-resource languages, they struggle with low-resource languages. Moreover, translating original texts into English proved to be beneficial for low-resource languages. These findings highlight the potential of LLMs for multilingual previously fact-checked claim detection and provide a foundation for further research on this promising application of LLMs.

View on arXivView PDF

Code Implementations(1)

The repository for the paper "Large Language Models for Multilingual Previously Fact-Checked Claim Detection"

41Python, Jupyter NotebookFeb 14, 20251 years ago
research-paper

Cite this paper

@article{vykopal2025large,
  title  = {Large Language Models for Multilingual Previously Fact-Checked Claim Detection},
  author = {Ivan Vykopal and Matúš Pikuliak and Simon Ostermann and Tatiana Anikina and Michal Gregor and Marián Šimko},
  year   = {2025},
  eprint = {2503.02737},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2503.02737v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2503.02737.svg)](https://codeofpaper.com/paper/2503.02737)

Discussion