Alzheimer Disease Classification through ASR-based Transcriptions: Exploring the Impact of Punctuation and Pauses

Lucía Gómez-Zaragozá, Simone Wills, Cristian Tejedor-Garcia, Javier Marín-Morales, Mariano Alcañiz +1 more
6/6/2023
cs.CLcs.SDeess.AS

No official code found. Best implementation: acw-upv/INTERSPEECH2023_AlzheimersDisease (8 stars, last commit 2025-06-15).

Abstract

Alzheimer's Disease (AD) is the world's leading neurodegenerative disease, which often results in communication difficulties. Analysing speech can serve as a diagnostic tool for identifying the condition. The recent ADReSS challenge provided a dataset for AD classification and highlighted the utility of manual transcriptions. In this study, we used the new state-of-the-art Automatic Speech Recognition (ASR) model Whisper to obtain the transcriptions, which also include automatic punctuation. The classification models achieved test accuracy scores of 0.854 and 0.833 combining the pretrained FastText word embeddings and recurrent neural networks on manual and ASR transcripts respectively. Additionally, we explored the influence of including pause information and punctuation in the transcriptions. We found that punctuation only yielded minor improvements in some cases, whereas pause encoding aided AD classification for both manual and ASR transcriptions across all approaches investigated.

View on arXivView PDF

Code Implementations(1)

acw-upv/INTERSPEECH2023_AlzheimersDiseaseCommunity73%

This repository contains the code for the INTERSPEECH2023 paper: "Alzheimer Disease Classification through ASR-based Transcriptions: Exploring the Impact of Punctuation and Pauses"

80Jupyter NotebookMay 25, 20231 years ago
alzheimer-disease-predictionautomatic-speech-recognitionnatural-language-processingspeech

Similar Papers

When Can You Prune Your Network? A Study of Intermediate Neurons in Multilingual Speech Parsing

82% match2026

Exploring Multimodal Approaches for Alzheimer's Disease Detection Using Patient Speech Transcript and Audio Data

82% match1 repo112023

Evaluating OpenAI's Whisper ASR for Punctuation Prediction and Topic Modeling of life histories of the Museum of the Person

82% match2023

Assessing Language Disorders using Artificial Intelligence: a Paradigm Shift

81% match2023

FullStop:Punctuation and Segmentation Prediction for Dutch with Transformers

81% match2023

Tuning In to Neural Encoding: Linking Human Brain and Artificial Supervised Representations of Language

81% match2023

Cite this paper

@article{gmezzaragoz2023alzheimer,
  title  = {Alzheimer Disease Classification through ASR-based Transcriptions: Exploring the Impact of Punctuation and Pauses},
  author = {Lucía Gómez-Zaragozá and Simone Wills and Cristian Tejedor-Garcia and Javier Marín-Morales and Mariano Alcañiz and Helmer Strik},
  year   = {2023},
  eprint = {2306.03443},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2306.03443v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2306.03443.svg)](https://codeofpaper.com/paper/2306.03443)

Discussion