Speech-MASSIVE: A Multilingual Speech Dataset for SLU and Beyond

Beomseok Lee, Ioan Calapodescu, Marco Gaido, Matteo Negri, Laurent Besacier
8/7/2024
cs.CLcs.SDeess.AS

Official code: hlt-mt/Speech-MASSIVE (25 stars, Apache-2.0, last commit 2025-10-08).

Abstract

We present Speech-MASSIVE, a multilingual Spoken Language Understanding (SLU) dataset comprising the speech counterpart for a portion of the MASSIVE textual corpus. Speech-MASSIVE covers 12 languages from different families and inherits from MASSIVE the annotations for the intent prediction and slot-filling tasks. Our extension is prompted by the scarcity of massively multilingual SLU datasets and the growing need for versatile speech datasets to assess foundation models (LLMs, speech encoders) across languages and tasks. We provide a multimodal, multitask, multilingual dataset and report SLU baselines using both cascaded and end-to-end architectures in various training scenarios (zero-shot, few-shot, and full fine-tune). Furthermore, we demonstrate the suitability of Speech-MASSIVE for benchmarking other tasks such as speech transcription, language identification, and speech translation. The dataset, models, and code are publicly available at: https://github.com/hlt-mt/Speech-MASSIVE

View on arXivView PDF

Code Implementations(1)

hlt-mt/Speech-MASSIVEOfficial100%
Apache-2.0

Speech-MASSIVE is a multilingual Spoken Language Understanding (SLU) dataset comprising the speech counterpart for a portion of the MASSIVE textual corpus.

251PythonJun 11, 20241 years agoApache-2.0

Similar Papers

Fleurs-SLU: A Massively Multilingual Benchmark for Spoken Language Understanding

87% match1 repo12025

Large Language Models for Expansion of Spoken Language Understanding Systems to New Languages

86% match1 repo162024

Teaching a Multilingual Large Language Model to Understand Multilingual Speech via Multi-Instructional Training

84% match1 repo32024

MAC-SLU: Multi-Intent Automotive Cabin Spoken Language Understanding Benchmark

84% match1 repo62025

Spoken Language Understanding on Unseen Tasks With In-Context Learning

83% match2025

M3-SLU: Evaluating Speaker-Attributed Reasoning in Multimodal Large Language Models

82% match2025

Cite this paper

@article{lee2024speechmassive,
  title  = {Speech-MASSIVE: A Multilingual Speech Dataset for SLU and Beyond},
  author = {Beomseok Lee and Ioan Calapodescu and Marco Gaido and Matteo Negri and Laurent Besacier},
  year   = {2024},
  eprint = {2408.03900},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2408.03900v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2408.03900.svg)](https://codeofpaper.com/paper/2408.03900)

Discussion