MERLIN: A Testbed for Multilingual Multimodal Entity Recognition and Linking

Sathyanarayanan Ramamoorthy, Vishwa Shah, Simran Khanuja, Zaid Sheikh, Shan Jie +3 more
10/16/2025
cs.CLcs.AI

Official code: rsathya4802/merlin (3 stars, last commit 2025-10-22).

Abstract

This paper introduces MERLIN, a novel testbed system for the task of Multilingual Multimodal Entity Linking. The created dataset includes BBC news article titles, paired with corresponding images, in five languages: Hindi, Japanese, Indonesian, Vietnamese, and Tamil, featuring over 7,000 named entity mentions linked to 2,500 unique Wikidata entities. We also include several benchmarks using multilingual and multimodal entity linking methods exploring different language models like LLaMa-2 and Aya-23. Our findings indicate that incorporating visual data improves the accuracy of entity linking, especially for entities where the textual context is ambiguous or insufficient, and particularly for models that do not have strong multilingual abilities. For the work, the dataset, methods are available here at https://github.com/rsathya4802/merlin

View on arXivView PDF

Code Implementations(1)

rsathya4802/merlinOfficial100%
30Shell, PythonNov 18, 202412 months ago

Similar Papers

UniMEL: A Unified Framework for Multimodal Entity Linking with Large Language Models

84% match1 repo132024

DWE+: Dual-Way Matching Enhanced Framework for Multimodal Entity Linking

82% match1 repo92024

DIM: Dynamic Integration of Multimodal Entity Linking with Large Language Model

82% match1 repo12024

Multilingual Entity Linking Using Dense Retrieval

82% match2024

VP-MEL: Visual Prompts Guided Multimodal Entity Linking

81% match2024

Vision-Language Models Struggle to Align Entities across Modalities

81% match2025

Cite this paper

@article{ramamoorthy2025merlin,
  title  = {MERLIN: A Testbed for Multilingual Multimodal Entity Recognition and Linking},
  author = {Sathyanarayanan Ramamoorthy and Vishwa Shah and Simran Khanuja and Zaid Sheikh and Shan Jie and Ann Chia and Shearman Chua and Graham Neubig},
  year   = {2025},
  eprint = {2510.14307},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2510.14307v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2510.14307.svg)](https://codeofpaper.com/paper/2510.14307)

Discussion