Historical Ink: 19th Century Latin American Spanish Newspaper Corpus with LLM OCR Correction

Laura Manrique-Gómez, Tony Montes, Arturo Rodríguez-Herrera, Rubén Manrique
7/4/2024
cs.CLcs.DL

No official code found. Best implementation: historicalink/LatamXIX (2 stars, MIT, last commit 2024-11-11).

Abstract

This paper presents two significant contributions: First, it introduces a novel dataset of 19th-century Latin American newspaper texts, addressing a critical gap in specialized corpora for historical and linguistic analysis in this region. Second, it develops a flexible framework that utilizes a Large Language Model for OCR error correction and linguistic surface form detection in digitized corpora. This semi-automated framework is adaptable to various contexts and datasets and is applied to the newly created dataset.

View on arXivView PDF

Code Implementations(1)

historicalink/LatamXIXCommunity100%
MIT
21Python, Jupyter NotebookMay 9, 20241 years agoMIT

Similar Papers

Historical Ink: Exploring Large Language Models for Irony Detection in 19th-Century Spanish

81% match1 repo12025

Multimodal LLMs for OCR, OCR Post-Correction, and Named Entity Recognition in Historical Documents

81% match2 repos102025

OCR Error Post-Correction with LLMs in Historical Documents: No Free Lunches

80% match2025

Seventeenth-Century Spanish American Notary Records for Fine-Tuning Spanish Large Language Models

79% match1 repo2024

Modern Models, Medieval Texts: A POS Tagging Study of Old Occitan

78% match2025

Detecting Latin in Historical Books with Large Language Models: A Multimodal Benchmark

78% match1 repo22025

Cite this paper

@article{manriquegmez2024historical,
  title  = {Historical Ink: 19th Century Latin American Spanish Newspaper Corpus with LLM OCR Correction},
  author = {Laura Manrique-Gómez and Tony Montes and Arturo Rodríguez-Herrera and Rubén Manrique},
  year   = {2024},
  eprint = {2407.12838},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2407.12838v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2407.12838.svg)](https://codeofpaper.com/paper/2407.12838)

Discussion