Emotion-Aware Prosodic Phrasing for Expressive Text-to-Speech

Rui Liu, Bin Liu, Haizhou Li
9/21/2023
cs.AI

Official code: AI-S2-Lab/EmoPP (22 stars, last commit 2024-08-20).

Abstract

Prosodic phrasing is crucial to the naturalness and intelligibility of end-to-end Text-to-Speech (TTS). There exist both linguistic and emotional prosody in natural speech. As the study of prosodic phrasing has been linguistically motivated, prosodic phrasing for expressive emotion rendering has not been well studied. In this paper, we propose an emotion-aware prosodic phrasing model, termed \textit{EmoPP}, to mine the emotional cues of utterance accurately and predict appropriate phrase breaks. We first conduct objective observations on the ESD dataset to validate the strong correlation between emotion and prosodic phrasing. Then the objective and subjective evaluations show that the EmoPP outperforms all baselines and achieves remarkable performance in terms of emotion expressiveness. The audio samples and the code are available at \url{https://github.com/AI-S2-Lab/EmoPP}.

View on arXivView PDF

Code Implementations(1)

AI-S2-Lab/EmoPPOfficial100%

[NCMMSC'2024] Emotion-Aware Prosodic Phrasing for Expressive Text-to-Speech

220CSS, HTMLSep 20, 20232 years ago

Similar Papers

Cite this paper

@article{liu2023emotionaware,
  title  = {Emotion-Aware Prosodic Phrasing for Expressive Text-to-Speech},
  author = {Rui Liu and Bin Liu and Haizhou Li},
  year   = {2023},
  eprint = {2309.11724},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2309.11724v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2309.11724.svg)](https://codeofpaper.com/paper/2309.11724)

Discussion