Addressing Logical Fallacies In Scientific Reasoning From Large Language Models: Towards a Dual-Inference Training Framework

Peter B. Walker, Hannah Davidson, Aiden Foster, Matthew Lienert, Thomas Pardue +1 more
12/3/2025
cs.AI

Official code: hannahdavidsoncollege-maker/ScientificReasoningForEnvironment-MedicineWithLLMs (0 stars, last commit 2025-12-05).

Abstract

Large Language Models (LLMs) have transformed natural language processing and hold growing promise for advancing science, healthcare, and decision-making. Yet their training paradigms remain dominated by affirmation-based inference, akin to \textit{modus ponens}, where accepted premises yield predicted consequents. While effective for generative fluency, this one-directional approach leaves models vulnerable to logical fallacies, adversarial manipulation, and failures in causal reasoning. This paper makes two contributions. First, it demonstrates how existing LLMs from major platforms exhibit systematic weaknesses when reasoning in scientific domains with negation, counterexamples, or faulty premises \footnote{Code to recreate these experiments are at https://github.com/hannahdavidsoncollege-maker/ScientificReasoningForEnvironment-MedicineWithLLMs. Second, it introduces a dual-reasoning training framework that integrates affirmative generation with structured counterfactual denial. Grounded in formal logic, cognitive science, and adversarial training, this training paradigm formalizes a computational analogue of ``denying the antecedent'' as a mechanism for disconfirmation and robustness. By coupling generative synthesis with explicit negation-aware objectives, the framework enables models that not only affirm valid inferences but also reject invalid ones, yielding systems that are more resilient, interpretable, and aligned with human reasoning.

View on arXivView PDF

Code Implementations(1)

A set of experiments in our paper to check how often logical fallacies occur in the environmental and medicine domain.

00Jupyter NotebookSep 25, 202510 months ago

Similar Papers

Cite this paper

@article{walker2025addressing,
  title  = {Addressing Logical Fallacies In Scientific Reasoning From Large Language Models: Towards a Dual-Inference Training Framework},
  author = {Peter B. Walker and Hannah Davidson and Aiden Foster and Matthew Lienert and Thomas Pardue and Dale Russell},
  year   = {2025},
  eprint = {2512.04228},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2512.04228v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2512.04228.svg)](https://codeofpaper.com/paper/2512.04228)

Discussion