The Serendipity of Claude AI: Case of the 13 Low-Resource National Languages of Mali

Alou Dembele, Nouhoum Souleymane Coulibaly, Michael Leventhal
3/5/2025
cs.CL

No confident code implementation found for this paper.

Abstract

Recent advances in artificial intelligence (AI) and natural language processing (NLP) have improved the representation of underrepresented languages. However, most languages, including Mali's 13 official national languages, continue to be poorly supported or unsupported by automatic translation and generative AI. This situation appears to have slightly improved with certain recent LLM releases. The study evaluated Claude AI's translation performance on each of the 13 national languages of Mali. In addition to ChrF2 and BLEU scores, human evaluators assessed translation accuracy, contextual consistency, robustness to dialect variations, management of linguistic bias, adaptation to a limited corpus, and ease of understanding. The study found that Claude AI performs robustly for languages with very modest language resources and, while unable to produce understandable and coherent texts for Malian languages with minimal resources, still manages to produce results which demonstrate the ability to mimic some elements of the language.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

From LLM to NMT: Advancing Low-Resource Machine Translation with Claude

84% match2024

Artificial intelligence contribution to translation industry: looking back and forward

84% match2024

How Well Do LLMs Understand Tunisian Arabic?

84% match2025

Where Are We? Evaluating LLM Performance on African Languages

83% match2025

AI Diffusion in Low Resource Language Countries

83% match2025

Tibetan Language and AI: A Comprehensive Survey of Resources, Methods and Challenges

83% match2025

Cite this paper

@article{dembele2025serendipity,
  title  = {The Serendipity of Claude AI: Case of the 13 Low-Resource National Languages of Mali},
  author = {Alou Dembele and Nouhoum Souleymane Coulibaly and Michael Leventhal},
  year   = {2025},
  eprint = {2503.03380},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2503.03380v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2503.03380.svg)](https://codeofpaper.com/paper/2503.03380)

Discussion