LLMs Can Get "Brain Rot"!

Shuo Xing, Junyuan Hong, Yifan Wang, Runjin Chen, Zhenyu Zhang +3 more
10/15/2025
cs.CLcs.AI

No official code found. Best implementation: llm-brain-rot/llm-brain-rot (161 stars, Apache-2.0, last commit 2026-01-09).

Abstract

We propose and test the LLM Brain Rot Hypothesis: continual exposure to junk web text induces lasting cognitive decline in large language models (LLMs). To causally isolate data quality, we run controlled experiments on real Twitter/X corpora, constructing junk and reversely controlled datasets via two orthogonal operationalizations: M1 (engagement degree) and M2 (semantic quality), with matched token scale and training operations across conditions. Contrary to the control group, continual pre-training of 4 LLMs on the junk dataset causes non-trivial declines (Hedges' $g>0.3$) on reasoning, long-context understanding, safety, and inflating "dark traits" (e.g., psychopathy, narcissism). The gradual mixtures of junk and control datasets also yield dose-response cognition decay: for example, under M1, ARC-Challenge with Chain Of Thoughts drops $74.9 \rightarrow 57.2$ and RULER-CWE $84.4 \rightarrow 52.3$ as junk ratio rises from $0\%$ to $100\%$. Error forensics reveal several key insights. First, we identify thought-skipping as the primary lesion: models increasingly truncate or skip reasoning chains, explaining most of the error growth. Second, partial but incomplete healing is observed: scaling instruction tuning and clean data pre-training improve the declined cognition yet cannot restore baseline capability, suggesting persistent representational drift rather than format mismatch. Finally, we discover that the popularity, a non-semantic metric, of a tweet is a better indicator of the Brain Rot effect than the length in M1. Together, the results provide significant, multi-perspective evidence that data quality is a causal driver of LLM capability decay, reframing curation for continual pretraining as a \textit{training-time safety} problem and motivating routine "cognitive health checks" for deployed LLMs.

View on arXivView PDF

Code Implementations(1)

Apache-2.0

LLM Can Get "Brain Rot"

16111Shell, PythonOct 17, 20259 months agoApache-2.0

Similar Papers

Cite this paper

@article{xing2025llms,
  title  = {LLMs Can Get "Brain Rot"!},
  author = {Shuo Xing and Junyuan Hong and Yifan Wang and Runjin Chen and Zhenyu Zhang and Ananth Grama and Zhengzhong Tu and Zhangyang Wang},
  year   = {2025},
  eprint = {2510.13928},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2510.13928v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2510.13928.svg)](https://codeofpaper.com/paper/2510.13928)

Discussion