Evaluating Self-supervised Speech Models on a Taiwanese Hokkien Corpus

Yi-Hui Chou, Kalvin Chang, Meng-Ju Wu, Winston Ou, Alice Wen-Hsin Bi +10 more
12/6/2023
cs.CLcs.SDeess.AS

No confident code implementation found for this paper.

Abstract

Taiwanese Hokkien is declining in use and status due to a language shift towards Mandarin in Taiwan. This is partly why it is a low resource language in NLP and speech research today. To ensure that the state of the art in speech processing does not leave Taiwanese Hokkien behind, we contribute a 1.5-hour dataset of Taiwanese Hokkien to ML-SUPERB's hidden set. Evaluating ML-SUPERB's suite of self-supervised learning (SSL) speech representations on our dataset, we find that model size does not consistently determine performance. In fact, certain smaller models outperform larger ones. Furthermore, linguistic alignment between pretraining data and the target language plays a crucial role.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Supervised Acoustic Embeddings And Their Transferability Across Languages

88% match2023

Non-Contrastive Self-supervised Learning for Utterance-Level Information Extraction from Speech

88% match2022

Ara-Best-RQ: Multi Dialectal Arabic SSL

87% match2026

Self-supervised Adaptive Pre-training of Multilingual Speech Models for Language and Dialect Identification

87% match2023

Speech Self-Supervised Representations Benchmarking: a Case for Larger Probing Heads

86% match2023

SpeechGLUE: How Well Can Self-Supervised Speech Models Capture Linguistic Knowledge?

86% match1 repo132023

Cite this paper

@article{chou2023evaluating,
  title  = {Evaluating Self-supervised Speech Models on a Taiwanese Hokkien Corpus},
  author = {Yi-Hui Chou and Kalvin Chang and Meng-Ju Wu and Winston Ou and Alice Wen-Hsin Bi and Carol Yang and Bryan Y. Chen and Rong-Wei Pai and Po-Yen Yeh and Jo-Peng Chiang and Iu-Tshian Phoann and Winnie Chang and Chenxuan Cui and Noel Chen and Jiatong Shi},
  year   = {2023},
  eprint = {2312.06668},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2312.06668v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2312.06668.svg)](https://codeofpaper.com/paper/2312.06668)

Discussion