Solving NLP Problems through Human-System Collaboration: A Discussion-based Approach

Masahiro Kaneko, Graham Neubig, Naoaki Okazaki
5/19/2023
cs.CL

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

Humans work together to solve common problems by having discussions, explaining, and agreeing or disagreeing with each other. Similarly, if a system can have discussions with humans when solving tasks, it can improve the system's performance and reliability. In previous research on explainability, it has only been possible for the system to make predictions and for humans to ask questions about them rather than having a mutual exchange of opinions. This research aims to create a dataset and computational framework for systems that discuss and refine their predictions through dialogue. Through experiments, we show that the proposed system can have beneficial discussions with humans improving the accuracy by up to 25 points in the natural language inference task.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Let Models Speak Ciphers: Multiagent Debate through Embeddings

86% match1 repo172026

InterroLang: Exploring NLP Models and Datasets through Dialogue-based Explanations

86% match1 repo82023

SAIE Framework: Support Alone Isn't Enough -- Advancing LLM Training with Adversarial Remarks

85% match2023

May I Ask a Follow-up Question? Understanding the Benefits of Conversations in Neural Network Explainability

85% match2023

TalkToModel: Explaining Machine Learning Models with Interactive Natural Language Conversations

84% match1 repo1302022

Automated Interactive Domain-Specific Conversational Agents that Understand Human Dialogs

83% match2023

Cite this paper

@article{kaneko2023solving,
  title  = {Solving NLP Problems through Human-System Collaboration: A Discussion-based Approach},
  author = {Masahiro Kaneko and Graham Neubig and Naoaki Okazaki},
  year   = {2023},
  eprint = {2305.11789},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2305.11789v3}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2305.11789.svg)](https://codeofpaper.com/paper/2305.11789)

Discussion