Prospects for inconsistency detection using large language models and sheaves

Steve Huntsman, Michael Robinson, Ludmilla Huntsman
1/30/2024
cs.CYcs.CLmath.AT

No official code found. Best implementation: SteveHuntsman/ProspectsForInconsistencyDetection (3 stars, CC0-1.0, last commit 2024-03-26). 1 more below.

Abstract

We demonstrate that large language models can produce reasonable numerical ratings of the logical consistency of claims. We also outline a mathematical approach based on sheaf theory for lifting such ratings to hypertexts such as laws, jurisprudence, and social media and evaluating their consistency globally. This approach is a promising avenue to increasing consistency in and of government, as well as to combating mis- and disinformation and related ills.

View on arXivView PDF

Code Implementations(2)

SteveHuntsman/ProspectsForInconsistencyDetectionCommunity100%
CC0-1.0

Scripts and data supporting "Prospects for inconsistency detection using large language models and sheaves"

32MATLAB, PythonJan 22, 20242 years agoCC0-1.0
AntonioJesusGarciaPalomo/Inconsistency-Detection-in-PromptsCommunity55%
MIT

This is just an example for demonstration purposes about what is exposed in the paper Huntsman, S., Robinson, M., & Huntsman, L. (2024). Prospects for inconsistency detection using large language models and sheaves. arXiv:2401.16713v1.

10Python, DockerfileMar 24, 20251 years agoMIT

Similar Papers

Measuring Moral Inconsistencies in Large Language Models

81% match2024

Epistemic Integrity in Large Language Models

81% match1 repo32024

ECon: On the Detection and Resolution of Evidence Conflicts

80% match1 repo22024

Knowledge-based Consistency Testing of Large Language Models

80% match1 repo2024

Fact-Checking with Large Language Models via Probabilistic Certainty and Consistency

80% match2026

DCR-Consistency: Divide-Conquer-Reasoning for Consistency Evaluation and Improvement of Large Language Models

80% match1 repo272024

Cite this paper

@article{huntsman2024prospects,
  title  = {Prospects for inconsistency detection using large language models and sheaves},
  author = {Steve Huntsman and Michael Robinson and Ludmilla Huntsman},
  year   = {2024},
  eprint = {2401.16713},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2401.16713v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2401.16713.svg)](https://codeofpaper.com/paper/2401.16713)

Discussion