Pitch-Aware RNN-T for Mandarin Chinese Mispronunciation Detection and Diagnosis

Xintong Wang, Mingqian Shi, Ye Wang
6/7/2024
cs.SDcs.CLeess.AS

No confident code implementation found for this paper.

Abstract

Mispronunciation Detection and Diagnosis (MDD) systems, leveraging Automatic Speech Recognition (ASR), face two main challenges in Mandarin Chinese: 1) The two-stage models create an information gap between the phoneme or tone classification stage and the MDD stage. 2) The scarcity of Mandarin MDD datasets limits model training. In this paper, we introduce a stateless RNN-T model for Mandarin MDD, utilizing HuBERT features with pitch embedding through a Pitch Fusion Block. Our model, trained solely on native speaker data, shows a 3% improvement in Phone Error Rate and a 7% increase in False Acceptance Rate over the state-of-the-art baseline in non-native scenarios

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Mispronunciation Detection and Diagnosis Without Model Training: A Retrieval-Based Approach

82% match2025

Data-Driven Mispronunciation Pattern Discovery for Robust Speech Recognition

80% match2025

Large Language Model Should Understand Pinyin for Chinese ASR Error Correction

78% match2024

Pinyin Regularization in Error Correction for Chinese Speech Recognition with Large Language Models

78% match1 repo162024

Segmentation-free Goodness of Pronunciation

77% match2025

Towards Comprehensive Semantic Speech Embeddings for Chinese Dialects

76% match1 repo12026

Cite this paper

@article{wang2024pitchaware,
  title  = {Pitch-Aware RNN-T for Mandarin Chinese Mispronunciation Detection and Diagnosis},
  author = {Xintong Wang and Mingqian Shi and Ye Wang},
  year   = {2024},
  eprint = {2406.04595},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2406.04595v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2406.04595.svg)](https://codeofpaper.com/paper/2406.04595)

Discussion