Detecting Syllable-Level Pronunciation Stress with A Self-Attention Model

Wang Weiying, Nakajima Akinori
11/1/2023
cs.SDcs.CLeess.AS

No official code found. Best implementation: wangweiying303/stress-detection-model (8 stars, last commit 2023-10-27).

Abstract

One precondition of effective oral communication is that words should be pronounced clearly, especially for non-native speakers. Word stress is the key to clear and correct English, and misplacement of syllable stress may lead to misunderstandings. Thus, knowing the stress level is important for English speakers and learners. This paper presents a self-attention model to identify the stress level for each syllable of spoken English. Various prosodic and categorical features, including the pitch level, intensity, duration and type of the syllable and its nuclei (the vowel of the syllable), are explored. These features are input to the self-attention model, and syllable-level stresses are predicted. The simplest model yields an accuracy of over 88% and 93% on different datasets, while more advanced models provide higher accuracy. Our study suggests that the self-attention model can be promising in stress-level detection. These models could be applied to various scenarios, such as online meetings and English learning.

View on arXivView PDF

Code Implementations(1)

Data collection, processing, training and testing of a self-attention model for syllable stress detection

80Python, Jupyter NotebookOct 26, 20232 years ago

Similar Papers

Cite this paper

@article{weiying2023detecting,
  title  = {Detecting Syllable-Level Pronunciation Stress with A Self-Attention Model},
  author = {Wang Weiying and Nakajima Akinori},
  year   = {2023},
  eprint = {2311.00301},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2311.00301v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2311.00301.svg)](https://codeofpaper.com/paper/2311.00301)

Discussion