Multi30K: Multilingual English-German Image Descriptions

Desmond Elliott, Stella Frank, Khalil Sima'an, Lucia Specia
5/2/2016
cs.CLcs.CV

Official code: multi30k/dataset (192 stars, last commit 2026-07-07).

Abstract

We introduce the Multi30K dataset to stimulate multilingual multimodal research. Recent advances in image description have been demonstrated on English-language datasets almost exclusively, but image description should not be limited to English. This dataset extends the Flickr30K dataset with i) German translations created by professional translators over a subset of the English descriptions, and ii) descriptions crowdsourced independently of the original English descriptions. We outline how the data can be used for multilingual image description and multimodal machine translation, but we anticipate the data will be useful for a broader range of tasks.

View on arXivView PDF

Code Implementations(1)

multi30k/datasetOfficial100%

Multi30k Dataset

19257Perl, RubyJan 12, 20183 months ago

Cite this paper

@article{elliott2016multik,
  title  = {Multi30K: Multilingual English-German Image Descriptions},
  author = {Desmond Elliott and Stella Frank and Khalil Sima'an and Lucia Specia},
  year   = {2016},
  eprint = {1605.00459},
  archivePrefix = {arXiv},
  url    = {https://arxiv.org/abs/1605.00459}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/1605.00459.svg)](https://codeofpaper.com/paper/1605.00459)

Discussion