Image-Text Relation Prediction for Multilingual Tweets

Matīss Rikters, Edison Marrese-Taylor
5/8/2025
cs.CLcs.AIcs.CV

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

Various social networks have been allowing media uploads for over a decade now. Still, it has not always been clear what is their relation with the posted text or even if there is any at all. In this work, we explore how multilingual vision-language models tackle the task of image-text relation prediction in different languages, and construct a dedicated balanced benchmark data set from Twitter posts in Latvian along with their manual translations into English. We compare our results to previous work and show that the more recently released vision-language model checkpoints are becoming increasingly capable at this task, but there is still much room for further improvement.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Exploring Vision Language Models for Multimodal and Multilingual Stance Detection

80% match2025

M2SA: Multimodal and Multilingual Model for Sentiment Analysis of Tweets

79% match1 repo72024

Constructing Multilingual Visual-Text Datasets Revealing Visual Multilingual Ability of Vision Language Models

79% match2024

Improving Multimodal Classification of Social Media Posts by Leveraging Image-Text Auxiliary Tasks

78% match1 repo52023

Why do LLaVA Vision-Language Models Reply to Images in English?

78% match2024

Alt-Text with Context: Improving Accessibility for Images on Twitter

78% match2026

Cite this paper

@article{rikters2025imagetext,
  title  = {Image-Text Relation Prediction for Multilingual Tweets},
  author = {Matīss Rikters and Edison Marrese-Taylor},
  year   = {2025},
  eprint = {2505.05040},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2505.05040v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2505.05040.svg)](https://codeofpaper.com/paper/2505.05040)

Discussion