Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Search

Jaehyeon Kim, Sungwon Kim, Jungil Kong, Sungroh Yoon
5/22/2020
eess.AScs.SD

Official code: jaywalnut310/glow-tts (713 stars, MIT, PyTorch, last commit 2022-07-12).

Abstract

Recently, text-to-speech (TTS) models such as FastSpeech and ParaNet have been proposed to generate mel-spectrograms from text in parallel. Despite the advantage, the parallel TTS models cannot be trained without guidance from autoregressive TTS models as their external aligners. In this work, we propose Glow-TTS, a flow-based generative model for parallel TTS that does not require any external aligner. By combining the properties of flows and dynamic programming, the proposed model searches for the most probable monotonic alignment between text and the latent representation of speech on its own. We demonstrate that enforcing hard monotonic alignments enables robust TTS, which generalizes to long utterances, and employing generative flows enables fast, diverse, and controllable speech synthesis. Glow-TTS obtains an order-of-magnitude speed-up over the autoregressive model, Tacotron 2, at synthesis with comparable speech quality. We further show that our model can be easily extended to a multi-speaker setting.

View on arXivView PDF

Code Implementations(1)

PyTorchMIT

A Generative Flow for Text-to-Speech via Monotonic Alignment Search

713155Shell, PythonMay 19, 20204 years agoMIT
deep-learningpytorchspeech-synthesistext-to-speechtts

Similar Papers

Cite this paper

@article{kim2020glowtts,
  title  = {Glow-TTS: A Generative Flow for Text-to-Speech via Monotonic Alignment Search},
  author = {Jaehyeon Kim and Sungwon Kim and Jungil Kong and Sungroh Yoon},
  year   = {2020},
  eprint = {2005.11129},
  archivePrefix = {arXiv},
  url    = {https://arxiv.org/abs/2005.11129}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2005.11129.svg)](https://codeofpaper.com/paper/2005.11129)

Discussion