Entropy of Ukrainian

Anton Lavreniuk, Mykyta Mudryi, Markiian Chaklosh
4/30/2026
cs.CL

No confident code implementation found for this paper.

Abstract

In natural language processing, the entropy of a language is a measure of its unpredictability and complexity. The first study on this subject was conducted by Claude Shannon in 1951. By having participants predict the next character in a sentence, he was able to approximate the entropy of the English language. Several follow-up studies by other authors have since been conducted for English, and one for Hebrew. However, to date, Shannon's experiment has never been conducted for Ukrainian. In this paper, we perform this experiment for Ukrainian by recruiting 184 volunteers using social media channels. We rely on techniques used for English to approximate the entropy value of Ukrainian. The final result is an upper bound of $H_{upper}\approx1.201$ bits per character. We compare this to the performance of current Large Language Models. The methods and code used are also documented and published, along with a discussion of the main challenges encountered.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Semantic Chunking and the Entropy of Natural Language

86% match2026

Entropy in Large Language Models

84% match2026

Can LLMs capture stable human-generated sentence entropy measures?

84% match1 repo2026

How Well Does First-Token Entropy Approximate Word Entropy as a Psycholinguistic Predictor?

83% match1 repo12025

Know Your Limits: Entropy Estimation Modeling for Compression and Generalization

82% match1 repo2025

Translation Entropy: A Statistical Framework for Evaluating Translation Systems

82% match2025

Cite this paper

@article{lavreniuk2026entropy,
  title  = {Entropy of Ukrainian},
  author = {Anton Lavreniuk and Mykyta Mudryi and Markiian Chaklosh},
  year   = {2026},
  eprint = {2604.27534},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2604.27534v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2604.27534.svg)](https://codeofpaper.com/paper/2604.27534)

Discussion