Learning More with Less: Self-Supervised Approaches for Low-Resource Speech Emotion Recognition

Ziwei Gong, Pengyuan Shi, Kaan Donbekci, Lin Ai, Run Chen +3 more
6/1/2025
cs.SDcs.CL

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

Speech Emotion Recognition (SER) has seen significant progress with deep learning, yet remains challenging for Low-Resource Languages (LRLs) due to the scarcity of annotated data. In this work, we explore unsupervised learning to improve SER in low-resource settings. Specifically, we investigate contrastive learning (CL) and Bootstrap Your Own Latent (BYOL) as self-supervised approaches to enhance cross-lingual generalization. Our methods achieve notable F1 score improvements of 10.6% in Urdu, 15.2% in German, and 13.9% in Bangla, demonstrating their effectiveness in LRLs. Additionally, we analyze model behavior to provide insights on key factors influencing performance across languages, and also highlighting challenges in low-resource SER. This work provides a foundation for developing more inclusive, explainable, and robust emotion recognition systems for underrepresented languages.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Large Language Models Meet Contrastive Learning: Zero-Shot Emotion Recognition Across Languages

86% match1 repo22025

Cross-Lingual Speech Emotion Recognition: Humans vs. Self-Supervised Models

86% match1 repo82024

Improving Speech Emotion Recognition in Under-Resourced Languages via Speech-to-Speech Translation with Bootstrapping Data Selection

86% match1 repo32024

SER Evals: In-domain and Out-of-domain Benchmarking for Speech Emotion Recognition

86% match1 repo112024

Emotion Classification in Low and Moderate Resource Languages

85% match2024

Exploring Self-Supervised Multi-view Contrastive Learning for Speech Emotion Recognition with Limited Annotations

85% match2024

Cite this paper

@article{gong2025learning,
  title  = {Learning More with Less: Self-Supervised Approaches for Low-Resource Speech Emotion Recognition},
  author = {Ziwei Gong and Pengyuan Shi and Kaan Donbekci and Lin Ai and Run Chen and David Sasu and Zehui Wu and Julia Hirschberg},
  year   = {2025},
  eprint = {2506.02059},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2506.02059v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2506.02059.svg)](https://codeofpaper.com/paper/2506.02059)

Discussion