Findings of the Third Shared Task on Multilingual Coreference Resolution

Michal Novák, Barbora Dohnalová, Miloslav Konopík, Anna Nedoluzhko, Martin Popel +5 more
10/21/2024
cs.CL

No official code found. Best implementation: ufal/corefud-scorer (5 stars, MIT, last commit 2025-01-30).

Abstract

The paper presents an overview of the third edition of the shared task on multilingual coreference resolution, held as part of the CRAC 2024 workshop. Similarly to the previous two editions, the participants were challenged to develop systems capable of identifying mentions and clustering them based on identity coreference. This year's edition took another step towards real-world application by not providing participants with gold slots for zero anaphora, increasing the task's complexity and realism. In addition, the shared task was expanded to include a more diverse set of languages, with a particular focus on historical languages. The training and evaluation data were drawn from version 1.2 of the multilingual collection of harmonized coreference resources CorefUD, encompassing 21 datasets across 15 languages. 6 systems competed in this shared task.

View on arXivView PDF

Code Implementations(1)

ufal/corefud-scorerCommunity100%
MIT

Coreference and anaphora scorer for CorefUD data

53Python, MakefileFeb 18, 20221 years agoMIT

Similar Papers

Findings of the Fourth Shared Task on Multilingual Coreference Resolution: Can LLMs Dethrone Traditional Approaches?

91% match2025

Findings of the Fifth Shared Task on Multilingual Coreference Resolution: Expanding Datasets for Long-Range Entities

86% match2026

Investigating Multilingual Coreference Resolution by Universal Annotations

86% match2023

Exploring Multiple Strategies to Improve Multilingual Coreference Resolution in CorefUD

85% match1 repo32024

BenCoref: A Multi-Domain Dataset of Nominal Phrases and Pronominal Reference Annotations

85% match2023

ÚFAL CorPipe at CRAC 2023: Larger Context Improves Multilingual Coreference Resolution

85% match1 repo52023

Cite this paper

@article{novk2024findings,
  title  = {Findings of the Third Shared Task on Multilingual Coreference Resolution},
  author = {Michal Novák and Barbora Dohnalová and Miloslav Konopík and Anna Nedoluzhko and Martin Popel and Ondřej Pražák and Jakub Sido and Milan Straka and Zdeněk Žabokrtský and Daniel Zeman},
  year   = {2024},
  eprint = {2410.15949},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2410.15949v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2410.15949.svg)](https://codeofpaper.com/paper/2410.15949)

Discussion