Enhancing Out-of-Vocabulary Performance of Indian TTS Systems for Practical Applications through Low-Effort Data Strategies

Srija Anand, Praveen Srinivasa Varadhan, Ashwin Sankar, Giri Raju, Mitesh M. Khapra
7/18/2024
cs.CLcs.LGcs.SD

No official code found. Best implementation: AI4Bharat/IndicOOV (2 stars, CC-BY-4.0, last commit 2024-09-10).

Abstract

Publicly available TTS datasets for low-resource languages like Hindi and Tamil typically contain 10-20 hours of data, leading to poor vocabulary coverage. This limitation becomes evident in downstream applications where domain-specific vocabulary coupled with frequent code-mixing with English, results in many OOV words. To highlight this problem, we create a benchmark containing OOV words from several real-world applications. Indeed, state-of-the-art Hindi and Tamil TTS systems perform poorly on this OOV benchmark, as indicated by intelligibility tests. To improve the model's OOV performance, we propose a low-effort and economically viable strategy to obtain more training data. Specifically, we propose using volunteers as opposed to high quality voice artists to record words containing character bigrams unseen in the training data. We show that using such inexpensive data, the model's performance improves on OOV words, while not affecting voice quality and in-domain performance.

View on arXivView PDF

Code Implementations(1)

AI4Bharat/IndicOOVCommunity100%
CC-BY-4.0
20Jun 11, 20242 years agoCC-BY-4.0

Similar Papers

Cite this paper

@article{anand2024enhancing,
  title  = {Enhancing Out-of-Vocabulary Performance of Indian TTS Systems for Practical Applications through Low-Effort Data Strategies},
  author = {Srija Anand and Praveen Srinivasa Varadhan and Ashwin Sankar and Giri Raju and Mitesh M. Khapra},
  year   = {2024},
  eprint = {2407.13435},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.13435v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.13435.svg)](https://codeofpaper.com/paper/2407.13435)

Discussion