Improving Grapheme-to-Phoneme Conversion through In-Context Knowledge Retrieval with Large Language Models

Dongrui Han, Mingyu Cui, Jiawen Kang, Xixin Wu, Xunying Liu +1 more
11/12/2024
cs.AI

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

Grapheme-to-phoneme (G2P) conversion is a crucial step in Text-to-Speech (TTS) systems, responsible for mapping grapheme to corresponding phonetic representations. However, it faces ambiguities problems where the same grapheme can represent multiple phonemes depending on contexts, posing a challenge for G2P conversion. Inspired by the remarkable success of Large Language Models (LLMs) in handling context-aware scenarios, contextual G2P conversion systems with LLMs' in-context knowledge retrieval (ICKR) capabilities are proposed to promote disambiguation capability. The efficacy of incorporating ICKR into G2P conversion systems is demonstrated thoroughly on the Librig2p dataset. In particular, the best contextual G2P conversion system using ICKR outperforms the baseline with weighted average phoneme error rate (PER) reductions of 2.0% absolute (28.9% relative). Using GPT-4 in the ICKR system can increase of 3.5% absolute (3.8% relative) on the Librig2p dataset.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Good Neighbors Are All You Need for Chinese Grapheme-to-Phoneme Conversion

84% match2023

LLM-Powered Grapheme-to-Phoneme Conversion: Benchmark and Case Study

81% match1 repo192024

TSPC: A Two-Stage Phoneme-Centric Architecture for code-switching Vietnamese-English Speech Recognition

79% match2025

DFIN-SQL: Integrating Focused Schema with DIN-SQL for Superior Accuracy in Large-Scale Databases

78% match2024

Disambiguation of Chinese Polyphones in an End-to-End Framework with Semantic Features Extracted by Pre-trained BERT

78% match2025

IPA-CHILDES & G2P+: Feature-Rich Resources for Cross-Lingual Phonology and Phonemic Language Modeling

77% match1 repo202025

Cite this paper

@article{han2024improving,
  title  = {Improving Grapheme-to-Phoneme Conversion through In-Context Knowledge Retrieval with Large Language Models},
  author = {Dongrui Han and Mingyu Cui and Jiawen Kang and Xixin Wu and Xunying Liu and Helen Meng},
  year   = {2024},
  eprint = {2411.07563},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2411.07563v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2411.07563.svg)](https://codeofpaper.com/paper/2411.07563)

Discussion