ltzGLUE: Luxembourgish General Language Understanding Evaluation

Alistair Plum, Felicia Körner, Anne-Marie Lutgen, Laura Bernardy, Fred Philippy +6 more
4/20/2026
cs.CL

No confident code implementation found for this paper.

Abstract

This paper presents ltzGLUE, the first Natural Language Understanding (NLU) benchmark for Luxembourgish (LTZ) based on the popular GLUE benchmark for English. Although NLU tasks are available for many European languages nowadays, LTZ is one of the official national languages that is often overlooked. We construct new tasks and reuse existing ones to introduce the first official NLU benchmark and accompanying evaluation of encoder models for the language. Our tasks include common natural language processing tasks in binary and multi-class classification settings, including named entity recognition, topic classification, and intent classification. We evaluate various pre-trained language models for LTZ to present an overview of the current capabilities of these models on the LTZ language.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

BLUEX: A benchmark based on Brazilian Leading Universities Entrance eXams

87% match1 repo202023

PromptCBLUE: A Chinese Prompt Tuning Benchmark for the Medical Domain

86% match1 repo3942023

Advancing the Evaluation of Traditional Chinese Language Models: Towards a Comprehensive Benchmark Suite

86% match1 repo2912023

WYWEB: A NLP Evaluation Benchmark For Classical Chinese

86% match1 repo212023

NorBench -- A Benchmark for Norwegian Language Models

85% match1 repo142023

BEIR-PL: Zero Shot Information Retrieval Benchmark for the Polish Language

85% match2023

Cite this paper

@article{plum2026ltzglue,
  title  = {ltzGLUE: Luxembourgish General Language Understanding Evaluation},
  author = {Alistair Plum and Felicia Körner and Anne-Marie Lutgen and Laura Bernardy and Fred Philippy and Emilia Milano and Nils Rehlinger and Cédric Lothritz and Tharindu Ranasinghe and Barbara Plank and Christoph Purschke},
  year   = {2026},
  eprint = {2604.17976},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2604.17976v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2604.17976.svg)](https://codeofpaper.com/paper/2604.17976)

Discussion