The Good, the Bad, and the Ugly: The Role of AI Quality Disclosure in Lie Detection

Haimanti Bhattacharya, Subhasish Dugar, Sanchaita Hazra, Bodhisattwa Prasad Majumder
10/30/2024
cs.CLcs.AIcs.CY

No confident code implementation found for this paper. 2 possible matches can be shown below.

Abstract

We investigate how low-quality AI advisors, lacking quality disclosures, can help spread text-based lies while seeming to help people detect lies. Participants in our experiment discern truth from lies by evaluating transcripts from a game show that mimicked deceptive social media exchanges on topics with objective truths. We find that when relying on low-quality advisors without disclosures, participants' truth-detection rates fall below their own abilities, which recovered once the AI's true effectiveness was revealed. Conversely, high-quality advisor enhances truth detection, regardless of disclosure. We discover that participants' expectations about AI capabilities contribute to their undue reliance on opaque, low-quality advisors.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 2 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

How to Catch an AI Liar: Lie Detection in Black-Box LLMs by Asking Unrelated Questions

84% match1 repo742023

Difficulties with Evaluating a Deception Detector for AIs

83% match2025

The MASK Benchmark: Disentangling Honesty From Accuracy in AI Systems

83% match2025

Lying to Win: Assessing LLM Deception through Human-AI Games and Parallel-World Probing

83% match2026

AI-LieDar: Examine the Trade-off Between Utility and Truthfulness in LLM Agents

83% match2024

LieCraft: A Multi-Agent Framework for Evaluating Deceptive Capabilities in Language Models

82% match2026

Cite this paper

@article{bhattacharya2024good,
  title  = {The Good, the Bad, and the Ugly: The Role of AI Quality Disclosure in Lie Detection},
  author = {Haimanti Bhattacharya and Subhasish Dugar and Sanchaita Hazra and Bodhisattwa Prasad Majumder},
  year   = {2024},
  eprint = {2410.23143},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2410.23143v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2410.23143.svg)](https://codeofpaper.com/paper/2410.23143)

Discussion