Voice Disorder Analysis: a Transformer-based Approach

Alkis Koudounas, Gabriele Ciravegna, Marco Fantini, Giovanni Succo, Erika Crosetti +2 more
6/20/2024
eess.AScs.LG

No official code found. Best implementation: koudounasalkis/AI4Voice (15 stars, Apache-2.0, last commit 2024-06-11).

Abstract

Voice disorders are pathologies significantly affecting patient quality of life. However, non-invasive automated diagnosis of these pathologies is still under-explored, due to both a shortage of pathological voice data, and diversity of the recording types used for the diagnosis. This paper proposes a novel solution that adopts transformers directly working on raw voice signals and addresses data shortage through synthetic data generation and data augmentation. Further, we consider many recording types at the same time, such as sentence reading and sustained vowel emission, by employing a Mixture of Expert ensemble to align the predictions on different data types. The experimental results, obtained on both public and private datasets, show the effectiveness of our solution in the disorder detection and classification tasks and largely improve over existing approaches.

View on arXivView PDF

Code Implementations(1)

Apache-2.0

This repo contains the code for "Voice Disorder Analysis: A Transformer-based Approach", accepted at Interspeech 2024

154Shell, PythonJun 6, 20242 years agoApache-2.0
audio-classificationdata-augmentationinterspeechmixture-of-expertsmultilingual+4 more

Similar Papers

Cite this paper

@article{koudounas2024voice,
  title  = {Voice Disorder Analysis: a Transformer-based Approach},
  author = {Alkis Koudounas and Gabriele Ciravegna and Marco Fantini and Giovanni Succo and Erika Crosetti and Tania Cerquitelli and Elena Baralis},
  year   = {2024},
  eprint = {2406.14693},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2406.14693v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2406.14693.svg)](https://codeofpaper.com/paper/2406.14693)

Discussion