A Repository of Conversational Datasets

Matthew Henderson, Paweł Budzianowski, Iñigo Casanueva, Sam Coope, Daniela Gerz +6 more
4/13/2019
cs.CL

Official code: PolyAI-LDN/conversational-datasets (1,408 stars, Apache-2.0, last commit 2019-11-16).

Abstract

Progress in Machine Learning is often driven by the availability of large datasets, and consistent evaluation metrics for comparing modeling approaches. To this end, we present a repository of conversational datasets consisting of hundreds of millions of examples, and a standardised evaluation procedure for conversational response selection models using '1-of-100 accuracy'. The repository contains scripts that allow researchers to reproduce the standard datasets, or to adapt the pre-processing and data filtering steps to their needs. We introduce and evaluate several competitive baselines for conversational response selection, whose implementations are shared in the repository, as well as a neural encoder model that is trained on the entire training set.

View on arXivView PDF

Code Implementations(1)

PolyAI-LDN/conversational-datasetsOfficial100%
Apache-2.0

Large datasets for conversational AI

1,408178Shell, PythonMar 7, 20196 years agoApache-2.0
conversational-aidatasetsmachine-learning

Similar Papers

DEnsity: Open-domain Dialogue Evaluation Metric using Density Estimation

85% match1 repo112023

A Systematic Evaluation of Response Selection for Open Domain Dialogue

85% match2022

The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems

84% match1 repo1362015

Improving Neural Conversational Models with Entropy-Based Data Filtering

84% match2 repos972019

DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generation

84% match1 repo2.4k2019

SimOAP: Improve Coherence and Consistency in Persona-based Dialogue Generation via Over-sampling and Post-evaluation

82% match2023

Cite this paper

@article{henderson2019repository,
  title  = {A Repository of Conversational Datasets},
  author = {Matthew Henderson and Paweł Budzianowski and Iñigo Casanueva and Sam Coope and Daniela Gerz and Girish Kumar and Nikola Mrkšić and Georgios Spithourakis and Pei-Hao Su and Ivan Vulić and Tsung-Hsien Wen},
  year   = {2019},
  eprint = {1904.06472},
  archivePrefix = {arXiv},
  url    = {https://arxiv.org/abs/1904.06472}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/1904.06472.svg)](https://codeofpaper.com/paper/1904.06472)

Discussion