Just as Humans Need Vaccines, So Do Models: Model Immunization to Combat Falsehoods

Shaina Raza, Rizwan Qureshi, Azib Farooq, Marcelo Lotif, Aman Chadha +2 more
5/23/2025
cs.CL

No confident code implementation found for this paper.

Abstract

Large language models (LLMs) reproduce misinformation by learning the linguistic patterns that make falsehoods persuasive, such as hedging, false presuppositions, and citation fabrication, rather than merely memorizing false facts. We propose model immunization: supervised fine-tuning on curated (false claim, correction) pairs injected as small "vaccine doses" (5-10\% of tokens) alongside truthful data. Unlike post-hoc filtering or preference-based alignment, immunization provides direct negative supervision on labeled falsehoods. Across four open-weight model families, immunization improves TruthfulQA accuracy by 12 points and misinformation rejection by 30 points with negligible capability loss. We outline design requirements, which includes, dosage, labeling, quarantine, diversity and call for standardized vaccine corpora and benchmarks that test generalization, making immunization a routine component of responsible LLM development

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{raza2025just,
  title  = {Just as Humans Need Vaccines, So Do Models: Model Immunization to Combat Falsehoods},
  author = {Shaina Raza and Rizwan Qureshi and Azib Farooq and Marcelo Lotif and Aman Chadha and Deval Pandya and Christos Emmanouilidis},
  year   = {2025},
  eprint = {2505.17870},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2505.17870v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2505.17870.svg)](https://codeofpaper.com/paper/2505.17870)

Discussion