An Exhaustive Evaluation of TTS- and VC-based Data Augmentation for ASR

Sewade Ogun, Vincent Colotte, Emmanuel Vincent
3/11/2025
eess.AScs.CL

No confident code implementation found for this paper.

Abstract

Augmenting the training data of automatic speech recognition (ASR) systems with synthetic data generated by text-to-speech (TTS) or voice conversion (VC) has gained popularity in recent years. Several works have demonstrated improvements in ASR performance using this augmentation approach. However, because of the lower diversity of synthetic speech, naively combining synthetic and real data often does not yield the best results. In this work, we leverage recently proposed flow-based TTS/VC models allowing greater speech diversity, and assess the respective impact of augmenting various speech attributes on the word error rate (WER) achieved by several ASR models. Pitch augmentation and VC-based speaker augmentation are found to be ineffective in our setup. Jointly augmenting all other attributes reduces the WER of a Conformer-Transducer model by 11\% relative on Common Voice and by up to 35\% relative on LibriSpeech compared to training on real data only.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Enhancing Low-Resource ASR through Versatile TTS: Bridging the Data Gap

87% match2024

On the Effect of Purely Synthetic Training Data for Different Automatic Speech Recognition Architectures

86% match2024

Text Generation with Speech Synthesis for ASR Data Augmentation

86% match2023

On the Problem of Text-To-Speech Model Selection for Synthetic Data Generation in Automatic Speech Recognition

84% match2024

A Self-Refining Framework for Enhancing ASR Using TTS-Synthesized Data

84% match2025

Hard-Synth: Synthesizing Diverse Hard Samples for ASR using Zero-Shot TTS and LLM

83% match2024

Cite this paper

@article{ogun2025exhaustive,
  title  = {An Exhaustive Evaluation of TTS- and VC-based Data Augmentation for ASR},
  author = {Sewade Ogun and Vincent Colotte and Emmanuel Vincent},
  year   = {2025},
  eprint = {2503.08954},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2503.08954v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2503.08954.svg)](https://codeofpaper.com/paper/2503.08954)

Discussion