Detecting Structured Language Alternations in Historical Documents by Combining Language Identification with Fourier Analysis

Hale Sirin, Sabrina Li, Tom Lippincott
1/25/2024
cs.CL

No confident code implementation found for this paper. 1 possible match can be shown below.

Abstract

In this study, we present a generalizable workflow to identify documents in a historic language with a nonstandard language and script combination, Armeno-Turkish. We introduce the task of detecting distinct patterns of multilinguality based on the frequency of structured language alternations within a document.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 1 weaker match is hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

DocLangID: Improving Few-Shot Training to Identify the Language of Historical Documents

80% match2023

Language Detection by Means of the Minkowski Norm: Identification Through Character Bigrams and Frequency Analysis

78% match2025

Historical Ink: Semantic Shift Detection for 19th Century Spanish

78% match2024

Automated Quality Control for Language Documentation: Detecting Phonotactic Inconsistencies in a Kokborok Wordlist

78% match2025

Detecting Turkish Synonyms Used in Different Time Periods

78% match2024

Detecting Latin in Historical Books with Large Language Models: A Multimodal Benchmark

78% match1 repo22025

Cite this paper

@article{sirin2024detecting,
  title  = {Detecting Structured Language Alternations in Historical Documents by Combining Language Identification with Fourier Analysis},
  author = {Hale Sirin and Sabrina Li and Tom Lippincott},
  year   = {2024},
  eprint = {2401.14569},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2401.14569v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2401.14569.svg)](https://codeofpaper.com/paper/2401.14569)

Discussion