DialogSum Challenge: Results of the Dialogue Summarization Shared Task

Yulong Chen, Naihao Deng, Yang Liu, Yue Zhang
8/8/2022
cs.CL

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

We report the results of DialogSum Challenge, the shared task on summarizing real-life scenario dialogues at INLG 2022. Four teams participate in this shared task and three submit their system reports, exploring different methods to improve the performance of dialogue summarization. Although there is a great improvement over the baseline models regarding automatic evaluation metrics, such as Rouge scores, we find that there is a salient gap between model generated outputs and human annotated summaries by human evaluation from multiple aspects. These findings demonstrate the difficulty of dialogue summarization and suggest that more fine-grained evaluatuion metrics are in need.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Can GPT models Follow Human Summarization Guidelines? A Study for Targeted Communication Goals

86% match1 repo12023

CADS: A Systematic Literature Review on the Challenges of Abstractive Dialogue Summarization

83% match2024

Exploring the Factual Consistency in Dialogue Comprehension of Large Language Models

83% match2023

Reference Matters: Benchmarking Factual Error Correction for Dialogue Summarization with Fine-grained Evaluation Framework

83% match1 repo32023

Increasing faithfulness in human-human dialog summarization with Spoken Language Understanding tasks

82% match2024

GUMSum: Multi-Genre Data and Evaluation for English Abstractive Summarization

82% match2023

Cite this paper

@article{chen2022dialogsum,
  title  = {DialogSum Challenge: Results of the Dialogue Summarization Shared Task},
  author = {Yulong Chen and Naihao Deng and Yang Liu and Yue Zhang},
  year   = {2022},
  eprint = {2208.03898},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2208.03898v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2208.03898.svg)](https://codeofpaper.com/paper/2208.03898)

Discussion