IntegrityAI at GenAI Detection Task 2: Detecting Machine-Generated Academic Essays in English and Arabic Using ELECTRA and Stylometry

Mohammad AL-Smadi
1/7/2025
cs.CLcs.AI

No confident code implementation found for this paper.

Abstract

Recent research has investigated the problem of detecting machine-generated essays for academic purposes. To address this challenge, this research utilizes pre-trained, transformer-based models fine-tuned on Arabic and English academic essays with stylometric features. Custom models based on ELECTRA for English and AraELECTRA for Arabic were trained and evaluated using a benchmark dataset. Proposed models achieved excellent results with an F1-score of 99.7%, ranking 2nd among of 26 teams in the English subtask, and 98.4%, finishing 1st out of 23 teams in the Arabic one.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

GenAI Content Detection Task 2: AI vs. Human -- Academic Essay Authenticity Challenge

88% match2024

AI-generated Essays: Characteristics and Implications on Automated Scoring and Academic Integrity

82% match2024

Detecting AI-Generated Essays in Writing Assessment: Responsible Use and Generalizability Across LLMs

81% match2026

BUSTED at AraGenEval Shared Task: A Comparative Study of Transformer-Based Models for Arabic AI-Generated Text Detection

81% match2025

LuxVeri at GenAI Detection Task 1: Inverse Perplexity Weighted Ensemble for Robust Detection of AI-Generated Text across English and Multilingual Contexts

80% match2025

AI Text Detectors and the Misclassification of Slightly Polished Arabic Text

79% match2025

Cite this paper

@article{alsmadi2025integrityai,
  title  = {IntegrityAI at GenAI Detection Task 2: Detecting Machine-Generated Academic Essays in English and Arabic Using ELECTRA and Stylometry},
  author = {Mohammad AL-Smadi},
  year   = {2025},
  eprint = {2501.05476},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2501.05476v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2501.05476.svg)](https://codeofpaper.com/paper/2501.05476)

Discussion