Is text normalization relevant for classifying medieval charters?

Florian Atzenhofer-Baumgartner, Tamás Kovács
8/29/2024
cs.CLcs.IR

No confident code implementation found for this paper.

Abstract

This study examines the impact of historical text normalization on the classification of medieval charters, specifically focusing on document dating and locating. Using a data set of Middle High German charters from a digital archive, we evaluate various classifiers, including traditional and transformer-based models, with and without normalization. Our results indicate that the given normalization minimally improves locating tasks but reduces accuracy for dating, implying that original texts contain crucial features that normalization may obscure. We find that support vector machines and gradient boosting outperform other models, questioning the efficiency of transformers for this use case. Results suggest a selective approach to historical text normalization, emphasizing the significance of preserving some textual characteristics that are critical for classification tasks in document analysis.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{atzenhoferbaumgartner2024text,
  title  = {Is text normalization relevant for classifying medieval charters?},
  author = {Florian Atzenhofer-Baumgartner and Tamás Kovács},
  year   = {2024},
  eprint = {2408.16446},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2408.16446v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2408.16446.svg)](https://codeofpaper.com/paper/2408.16446)

Discussion