Benchmarking Automatic Speech Recognition Tools for Iberian Languages

Fernando López, Pablo Gómez, David Solans, Paulo Villegas, Jordi Luque
9/29/2026
cs.CL

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

Comprehensive evaluations of automatic speech recognition (ASR) for Iberian languages remain limited, and low-resource languages, biases, and efficiency trade-offs are underexplored. We benchmark eleven systems, ten open-weight models and one commercial API, across five Iberian languages (Basque, Catalan, Galician, Portuguese, Spanish), with German and Turkish as controls. Evaluation uses an 85-hour dataset covering read speech, broadcast media, and audiobooks, assessing accuracy and efficiency via word error rate (WER) and real-time factors (RTF/RTFx). Results show no single model dominates: accuracy, efficiency, and language coverage present clear trade-offs. Low-resource languages, especially Basque, degrade significantly, highlighting the role of training coverage. We observe consistent sex disparities across most systems, highlighting fairness challenges in multilingual ASR. Overall, the benchmark provides practical guidance for real-world model selection.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

LoASR-Bench: Evaluating Large Speech Language Models on Low-Resource Automatic Speech Recognition Across Language Families

90% match2026

Evaluating Bias in Phoneme-Based Automatic Speech Recognition Systems: An Analysis of IPA Transcription Models

90% match2026

BIGOS V2 Benchmark for Polish ASR: Curated Datasets and Tools for Reproducible Evaluation

90% match2026

Boosting Norwegian Automatic Speech Recognition

89% match2023

Polyglot-Lion: Efficient Multilingual ASR for Singapore via Balanced Fine-Tuning of Qwen3-ASR

89% match1 repo72026

Monsoon: Scalable Spontaneous Speech Collection for Low-Resource ASR in 50 Languages

88% match2026

Cite this paper

@article{lpez2026benchmarking,
  title  = {Benchmarking Automatic Speech Recognition Tools for Iberian Languages},
  author = {Fernando López and Pablo Gómez and David Solans and Paulo Villegas and Jordi Luque},
  year   = {2026},
  eprint = {2609.36920},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2609.36920v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2609.36920.svg)](https://codeofpaper.com/paper/2609.36920)

Discussion