Fetch-A-Set: A Large-Scale OCR-Free Benchmark for Historical Document Retrieval

Adrià Molina, Oriol Ramos Terrades, Josep Lladós
6/11/2024
cs.IRcs.CV

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

This paper introduces Fetch-A-Set (FAS), a comprehensive benchmark tailored for legislative historical document analysis systems, addressing the challenges of large-scale document retrieval in historical contexts. The benchmark comprises a vast repository of documents dating back to the XVII century, serving both as a training resource and an evaluation benchmark for retrieval systems. It fills a critical gap in the literature by focusing on complex extractive tasks within the domain of cultural heritage. The proposed benchmark tackles the multifaceted problem of historical document analysis, including text-to-image retrieval for queries and image-to-text topic extraction from document fragments, all while accommodating varying levels of document legibility. This benchmark aims to spur advancements in the field by providing baselines and data for the development and evaluation of robust historical document retrieval systems, particularly in scenarios characterized by wide historical spectrum.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

ClapperText: A Benchmark for Text Recognition in Low-Resource Archival Documents

81% match1 repo12025

Beyond the Pipeline: Analyzing Key Factors in End-to-End Deep Learning for Historical Writer Identification

79% match2025

Hybrid Retrieval-Augmented Generation for Robust Multilingual Document Question Answering

79% match2025

LegalBench-RAG: A Benchmark for Retrieval-Augmented Generation in the Legal Domain

79% match1 repo2072024

CHURRO: Making History Readable with an Open-Weight Large Vision-Language Model for High-Accuracy, Low-Cost Historical Text Recognition

78% match1 repo702025

SegHist: A General Segmentation-based Framework for Chinese Historical Document Text Line Detection

78% match1 repo92024

Cite this paper

@article{molina2024fetchaset,
  title  = {Fetch-A-Set: A Large-Scale OCR-Free Benchmark for Historical Document Retrieval},
  author = {Adrià Molina and Oriol Ramos Terrades and Josep Lladós},
  year   = {2024},
  eprint = {2406.07315},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2406.07315v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2406.07315.svg)](https://codeofpaper.com/paper/2406.07315)

Discussion