Controllable Emphasis with zero data for text-to-speech

Arnaud Joly, Marco Nicolis, Ekaterina Peterova, Alessandro Lombardi, Ammar Abbas +9 more
7/13/2023
eess.AScs.LGcs.SD

No confident code implementation found for this paper.

Abstract

We present a scalable method to produce high quality emphasis for text-to-speech (TTS) that does not require recordings or annotations. Many TTS models include a phoneme duration model. A simple but effective method to achieve emphasized speech consists in increasing the predicted duration of the emphasised word. We show that this is significantly better than spectrogram modification techniques improving naturalness by $7.3\%$ and correct testers' identification of the emphasized word in a sentence by $40\%$ on a reference female en-US voice. We show that this technique significantly closes the gap to methods that require explicit recordings. The method proved to be scalable and preferred in all four languages tested (English, Spanish, Italian, German), for different voices and multiple speaking styles.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{joly2023controllable,
  title  = {Controllable Emphasis with zero data for text-to-speech},
  author = {Arnaud Joly and Marco Nicolis and Ekaterina Peterova and Alessandro Lombardi and Ammar Abbas and Arent van Korlaar and Aman Hussain and Parul Sharma and Alexis Moinet and Mateusz Lajszczak and Penny Karanasou and Antonio Bonafonte and Thomas Drugman and Elena Sokolova},
  year   = {2023},
  eprint = {2307.07062},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2307.07062v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2307.07062.svg)](https://codeofpaper.com/paper/2307.07062)

Discussion