DetectAnyLLM: Towards Generalizable and Robust Detection of Machine-Generated Text Across Domains and Models

Jiachen Fu, Chun-Le Guo, Chongyi Li
9/15/2025
cs.CLcs.AIcs.CY

No official code found. Best implementation: fjc2005/DetectAnyLLM (25 stars, last commit 2025-09-23).

Abstract

The rapid advancement of large language models (LLMs) has drawn urgent attention to the task of machine-generated text detection (MGTD). However, existing approaches struggle in complex real-world scenarios: zero-shot detectors rely heavily on scoring model's output distribution while training-based detectors are often constrained by overfitting to the training data, limiting generalization. We found that the performance bottleneck of training-based detectors stems from the misalignment between training objective and task needs. To address this, we propose Direct Discrepancy Learning (DDL), a novel optimization strategy that directly optimizes the detector with task-oriented knowledge. DDL enables the detector to better capture the core semantics of the detection task, thereby enhancing both robustness and generalization. Built upon this, we introduce DetectAnyLLM, a unified detection framework that achieves state-of-the-art MGTD performance across diverse LLMs. To ensure a reliable evaluation, we construct MIRAGE, the most diverse multi-task MGTD benchmark. MIRAGE samples human-written texts from 10 corpora across 5 text-domains, which are then re-generated or revised using 17 cutting-edge LLMs, covering a wide spectrum of proprietary models and textual styles. Extensive experiments on MIRAGE reveal the limitations of existing methods in complex environment. In contrast, DetectAnyLLM consistently outperforms them, achieving over a 70% performance improvement under the same training data and base scoring model, underscoring the effectiveness of our DDL. Project page: {https://fjc2005.github.io/detectanyllm}.

View on arXivView PDF

Code Implementations(1)

[ACMMM 2025] Official Code of DetectAnyLLM: Towards Generalizable and Robust Detection of Machine-Generated Text Across Domains and Models

253Shell, PythonMar 13, 20251 years agoNOASSERTION

Similar Papers

Cite this paper

@article{fu2025detectanyllm,
  title  = {DetectAnyLLM: Towards Generalizable and Robust Detection of Machine-Generated Text Across Domains and Models},
  author = {Jiachen Fu and Chun-Le Guo and Chongyi Li},
  year   = {2025},
  eprint = {2509.14268},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2509.14268v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2509.14268.svg)](https://codeofpaper.com/paper/2509.14268)

Discussion