Can a Neural Model Guide Fieldwork? A Case Study on Morphological Data Collection

Aso Mahmudi, Borja Herce, Demian Inostroza Amestica, Andreas Scherbakov, Eduard Hovy +1 more
9/22/2024
cs.CL

No official code found. Best implementation: Aso-UniMelb/neural-fieldwork-guide (1 star, MIT, last commit 2024-11-30).

Abstract

Linguistic fieldwork is an important component in language documentation and preservation. However, it is a long, exhaustive, and time-consuming process. This paper presents a novel model that guides a linguist during the fieldwork and accounts for the dynamics of linguist-speaker interactions. We introduce a novel framework that evaluates the efficiency of various sampling strategies for obtaining morphological data and assesses the effectiveness of state-of-the-art neural models in generalising morphological structures. Our experiments highlight two key strategies for improving the efficiency: (1) increasing the diversity of annotated data by uniform sampling among the cells of the paradigm tables, and (2) using model confidence as a guide to enhance positive interaction by providing reliable predictions during annotation.

View on arXivView PDF

Code Implementations(1)

MIT

Can a Neural Model Guide Fieldwork? A Case Study on Morphological Inflection

10Shell, PythonSep 19, 20241 years agoMIT

Similar Papers

Cite this paper

@article{mahmudi2024neural,
  title  = {Can a Neural Model Guide Fieldwork? A Case Study on Morphological Data Collection},
  author = {Aso Mahmudi and Borja Herce and Demian Inostroza Amestica and Andreas Scherbakov and Eduard Hovy and Ekaterina Vylomova},
  year   = {2024},
  eprint = {2409.14628},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2409.14628v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2409.14628.svg)](https://codeofpaper.com/paper/2409.14628)

Discussion