Industrialized Deception: The Collateral Effects of LLM-Generated Misinformation on Digital Ecosystems

Alexander Loth, Martin Kappes, Marc-Oliver Pahl
1/29/2026
cs.CYcs.AIcs.CL

No official code found. Best implementation: aloth/JudgeGPT (9 stars, GPL-3.0, last commit 2026-03-22). 1 more below.

Abstract

Generative AI and misinformation research has evolved since our 2024 survey. This paper presents an updated perspective, transitioning from literature review to practical countermeasures. We report on changes in the threat landscape, including improved AI-generated content through Large Language Models (LLMs) and multimodal systems. Central to this work are our practical contributions: JudgeGPT, a platform for evaluating human perception of AI-generated news, and RogueGPT, a controlled stimulus generation engine for research. Together, these tools form an experimental pipeline for studying how humans perceive and detect AI-generated misinformation. Our findings show that detection capabilities have improved, but the competition between generation and detection continues. We discuss mitigation strategies including LLM-based detection, inoculation approaches, and the dual-use nature of generative AI. This work contributes to research addressing the adverse impacts of AI on information quality.

View on arXivView PDF

Code Implementations(2)

aloth/RogueGPTCommunity73%
GPL-3.0

RogueGPT: A controlled stimulus generator for AI news authenticity research. (arXiv:2601.21963 and arXiv:2601.22871)

83PythonMar 21, 20247 months agoGPL-3.0
ai-content-generationai-experimentcomputational-linguisticscontrolled-experimentdeepfakes+15 more
aloth/JudgeGPTCommunity72%
GPL-3.0

JudgeGPT: An empirical research platform for evaluating the authenticity of AI-generated news. (arXiv:2601.21963 and arXiv:2601.22871)

91PythonMar 21, 20247 months agoGPL-3.0
ai-ethicsai-evaluationcomputational-social-sciencecrowdsource-experimentsdata-collection+15 more

Similar Papers

Factuality Challenges in the Era of Large Language Models

88% match2023

Have LLMs Reopened the Pandora's Box of AI-Generated Fake News?

88% match2024

Evaluating the Efficacy of Large Language Models in Detecting Fake News: A Comparative Analysis

87% match2024

Blessing or curse? A survey on the Impact of Generative AI on Fake News

87% match2024

Fake Artificial Intelligence Generated Contents (FAIGC): A Survey of Theories, Detection Methods, and Opportunities

87% match2024

Unmasking Digital Falsehoods: A Comparative Analysis of LLM-Based Misinformation Detection Strategies

87% match2025

Cite this paper

@article{loth2026industrialized,
  title  = {Industrialized Deception: The Collateral Effects of LLM-Generated Misinformation on Digital Ecosystems},
  author = {Alexander Loth and Martin Kappes and Marc-Oliver Pahl},
  year   = {2026},
  eprint = {2601.21963},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2601.21963v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2601.21963.svg)](https://codeofpaper.com/paper/2601.21963)

Discussion