MultiTurnCleanup: A Benchmark for Multi-Turn Spoken Conversational Transcript Cleanup

Hua Shen, Vicky Zayats, Johann C. Rocholl, Daniel D. Walker, Dirk Padfield
5/19/2023
cs.CLcs.AIcs.LG

No official code found. Best implementation: huashen218/MultiTurnCleanup (5 stars, last commit 2023-11-30).

Abstract

Current disfluency detection models focus on individual utterances each from a single speaker. However, numerous discontinuity phenomena in spoken conversational transcripts occur across multiple turns, hampering human readability and the performance of downstream NLP tasks. This study addresses these phenomena by proposing an innovative Multi-Turn Cleanup task for spoken conversational transcripts and collecting a new dataset, MultiTurnCleanup1. We design a data labeling schema to collect the high-quality dataset and provide extensive data analysis. Furthermore, we leverage two modeling approaches for experimental evaluation as benchmarks for future research.

View on arXivView PDF

Code Implementations(1)

huashen218/MultiTurnCleanupCommunity100%
50May 9, 20232 years ago

Similar Papers

Mind the Pause: Disfluency-Aware Objective Tuning for Multilingual Speech Correction with LLMs

80% match1 repo2026

Automatic Disfluency Detection from Untranscribed Speech

80% match1 repo362023

Augmenting Automatic Speech Recognition Models with Disfluency Detection

80% match2024

DRES: Benchmarking LLMs for Disfluency Removal

79% match2025

Multimodal Contextual Dialogue Breakdown Detection for Conversational AI Models

78% match2024

Audio MultiChallenge: A Multi-Turn Evaluation of Spoken Dialogue Systems on Natural Human Interaction

78% match2025

Cite this paper

@article{shen2023multiturncleanup,
  title  = {MultiTurnCleanup: A Benchmark for Multi-Turn Spoken Conversational Transcript Cleanup},
  author = {Hua Shen and Vicky Zayats and Johann C. Rocholl and Daniel D. Walker and Dirk Padfield},
  year   = {2023},
  eprint = {2305.12029},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2305.12029v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2305.12029.svg)](https://codeofpaper.com/paper/2305.12029)

Discussion