The X-LANCE Technical Report for Interspeech 2024 Speech Processing Using Discrete Speech Unit Challenge

Yiwei Guo, Chenrun Wang, Yifan Yang, Hankun Wang, Ziyang Ma +7 more
4/9/2024
eess.AScs.AI

No confident code implementation found for this paper.

Abstract

Discrete speech tokens have been more and more popular in multiple speech processing fields, including automatic speech recognition (ASR), text-to-speech (TTS) and singing voice synthesis (SVS). In this paper, we describe the systems developed by the SJTU X-LANCE group for the TTS (acoustic + vocoder), SVS, and ASR tracks in the Interspeech 2024 Speech Processing Using Discrete Speech Unit Challenge. Notably, we achieved 1st rank on the leaderboard in the TTS track both with the whole training set and only 1h training data, with the highest UTMOS score and lowest bitrate among all submissions.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

ICMC-ASR: The ICASSP 2024 In-Car Multi-Channel Automatic Speech Recognition Challenge

85% match2024

The NPU-HWC System for the ISCSLP 2024 Inspirational and Convincing Audio Generation Challenge

83% match2024

ICASSP 2024 Speech Signal Improvement Challenge

83% match1 repo932024

The ISCSLP 2024 Conversational Voice Clone (CoVoC) Challenge: Tasks, Results and Findings

81% match2024

SVDD Challenge 2024: A Singing Voice Deepfake Detection Challenge Evaluation Plan

81% match1 repo302024

DASB - Discrete Audio and Speech Benchmark

81% match2024

Cite this paper

@article{guo2024xlance,
  title  = {The X-LANCE Technical Report for Interspeech 2024 Speech Processing Using Discrete Speech Unit Challenge},
  author = {Yiwei Guo and Chenrun Wang and Yifan Yang and Hankun Wang and Ziyang Ma and Chenpeng Du and Shuai Wang and Hanzheng Li and Shuai Fan and Hui Zhang and Xie Chen and Kai Yu},
  year   = {2024},
  eprint = {2404.06079},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2404.06079v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2404.06079.svg)](https://codeofpaper.com/paper/2404.06079)

Discussion