Optimizing Two-Pass Cross-Lingual Transfer Learning: Phoneme Recognition and Phoneme to Grapheme Translation

Wonjun Lee, Gary Geunbae Lee, Yunsu Kim
12/6/2023
cs.CLcs.SDeess.AS

No confident code implementation found for this paper.

Abstract

This research optimizes two-pass cross-lingual transfer learning in low-resource languages by enhancing phoneme recognition and phoneme-to-grapheme translation models. Our approach optimizes these two stages to improve speech recognition across languages. We optimize phoneme vocabulary coverage by merging phonemes based on shared articulatory characteristics, thus improving recognition accuracy. Additionally, we introduce a global phoneme noise generator for realistic ASR noise during phoneme-to-grapheme training to reduce error propagation. Experiments on the CommonVoice 12.0 dataset show significant reductions in Word Error Rate (WER) for low-resource languages, highlighting the effectiveness of our approach. This research contributes to the advancements of two-pass ASR systems in low-resource languages, offering the potential for improved cross-lingual transfer learning.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Advancing LLM-based phoneme-to-grapheme for multilingual speech recognition

88% match2026

Allophant: Cross-lingual Phoneme Recognition with Articulatory Attributes

88% match1 repo302023

The Effects of Input Type and Pronunciation Dictionary Usage in Transfer Learning for Low-Resource Text-to-Speech

88% match2023

Analysing Cross-Lingual Transfer in Low-Resourced African Named Entity Recognition

87% match1 repo72023

From Sinhala to Dhivehi: Cross-Lingual Transfer Learning for Low-Resource Speech Recognition

86% match2026

Strategies in Transfer Learning for Low-Resource Speech Synthesis: Phone Mapping, Features Input, and Source Language Selection

86% match2023

Cite this paper

@article{lee2023optimizing,
  title  = {Optimizing Two-Pass Cross-Lingual Transfer Learning: Phoneme Recognition and Phoneme to Grapheme Translation},
  author = {Wonjun Lee and Gary Geunbae Lee and Yunsu Kim},
  year   = {2023},
  eprint = {2312.03312},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2312.03312v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2312.03312.svg)](https://codeofpaper.com/paper/2312.03312)

Discussion