To Err is AI : A Case Study Informing LLM Flaw Reporting Practices

Sean McGregor, Allyson Ettinger, Nick Judd, Paul Albee, Liwei Jiang +8 more
10/15/2024
cs.CYcs.LGcs.SE

No confident code implementation found for this paper.

Abstract

In August of 2024, 495 hackers generated evaluations in an open-ended bug bounty targeting the Open Language Model (OLMo) from The Allen Institute for AI. A vendor panel staffed by representatives of OLMo's safety program adjudicated changes to OLMo's documentation and awarded cash bounties to participants who successfully demonstrated a need for public disclosure clarifying the intent, capacities, and hazards of model deployment. This paper presents a collection of lessons learned, illustrative of flaw reporting best practices intended to reduce the likelihood of incidents and produce safer large language models (LLMs). These include best practices for safety reporting processes, their artifacts, and safety program staffing.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Large Language Model Safety: A Holistic Survey

85% match1 repo562024

A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment

84% match2025

From Model to Breach: Towards Actionable LLM-Generated Vulnerabilities Reporting

84% match2025

How Safe Are AI-Generated Patches? A Large-scale Study on Security Risks in LLM and Agentic Automated Program Repair on SWE-bench

84% match2025

Unveiling the Misuse Potential of Base Large Language Models via In-Context Learning

84% match2024

Transforming Computer Security and Public Trust Through the Exploration of Fine-Tuning Large Language Models

83% match2024

Cite this paper

@article{mcgregor2024case,
  title  = {To Err is AI : A Case Study Informing LLM Flaw Reporting Practices},
  author = {Sean McGregor and Allyson Ettinger and Nick Judd and Paul Albee and Liwei Jiang and Kavel Rao and Will Smith and Shayne Longpre and Avijit Ghosh and Christopher Fiorelli and Michelle Hoang and Sven Cattell and Nouha Dziri},
  year   = {2024},
  eprint = {2410.12104},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2410.12104v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2410.12104.svg)](https://codeofpaper.com/paper/2410.12104)

Discussion