Zero-shot Temporal Relation Extraction with ChatGPT

Chenhan Yuan, Qianqian Xie, Sophia Ananiadou
4/11/2023
cs.CLcs.AI

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

The goal of temporal relation extraction is to infer the temporal relation between two events in the document. Supervised models are dominant in this task. In this work, we investigate ChatGPT's ability on zero-shot temporal relation extraction. We designed three different prompt techniques to break down the task and evaluate ChatGPT. Our experiments show that ChatGPT's performance has a large gap with that of supervised methods and can heavily rely on the design of prompts. We further demonstrate that ChatGPT can infer more small relation classes correctly than supervised methods. The current shortcomings of ChatGPT on temporal relation extraction are also discussed in this paper. We found that ChatGPT cannot keep consistency during temporal inference and it fails in actively long-dependency temporal inference.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

More than Classification: A Unified Framework for Event Temporal Relation Extraction

87% match2023

Analysing zero-shot temporal relation extraction on clinical notes using temporal consistency

86% match1 repo32024

Beyond Pairwise: Global Zero-shot Temporal Graph Generation

86% match2025

TIMELINE: Exhaustive Annotation of Temporal Relations Supporting the Automatic Ordering of Events in News Articles

84% match1 repo52023

Chain of Thought with Explicit Evidence Reasoning for Few-shot Relation Extraction

83% match2023

TC-GAT: Graph Attention Network for Temporal Causality Discovery

83% match2023

Cite this paper

@article{yuan2023zeroshot,
  title  = {Zero-shot Temporal Relation Extraction with ChatGPT},
  author = {Chenhan Yuan and Qianqian Xie and Sophia Ananiadou},
  year   = {2023},
  eprint = {2304.05454},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2304.05454v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2304.05454.svg)](https://codeofpaper.com/paper/2304.05454)

Discussion