The AI Model Risk Catalog: What Developers and Researchers Miss About Real-World AI Harms

Pooja S. B. Rao, Sanja Šćepanović, Dinesh Babu Jayagopi, Mauro Cherubini, Daniele Quercia
8/21/2025
cs.CYcs.AI

No confident code implementation found for this paper.

Abstract

We analyzed nearly 460,000 AI model cards from Hugging Face to examine how developers report risks. From these, we extracted around 3,000 unique risk mentions and built the \emph{AI Model Risk Catalog}. We compared these with risks identified by researchers in the MIT Risk Repository and with real-world incidents from the AI Incident Database. Developers focused on technical issues like bias and safety, while researchers emphasized broader social impacts. Both groups paid little attention to fraud and manipulation, which are common harms arising from how people interact with AI. Our findings show the need for clearer, structured risk reporting that helps developers think about human-interaction and systemic risks early in the design process. The catalog and paper appendix are available at: https://social-dynamics.net/ai-risks/catalog.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

The AI Risk Spectrum: From Dangerous Capabilities to Existential Threats

83% match2025

ParanoiaEval: Benchmarking Unnecessary Defensive Work in Agentic Coding

81% match2026

Assessing Language Model Deployment with Risk Cards

80% match1 repo352023

The Digital Divide in Process Safety: Quantitative Risk Analysis of Human-AI Collaboration

80% match2023

HAICOSYSTEM: An Ecosystem for Sandboxing Safety Risks in Human-AI Interactions

80% match2024

AI Risk Profiles: A Standards Proposal for Pre-Deployment AI Risk Disclosures

80% match2023

Cite this paper

@article{rao2025model,
  title  = {The AI Model Risk Catalog: What Developers and Researchers Miss About Real-World AI Harms},
  author = {Pooja S. B. Rao and Sanja Šćepanović and Dinesh Babu Jayagopi and Mauro Cherubini and Daniele Quercia},
  year   = {2025},
  eprint = {2508.16672},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2508.16672v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2508.16672.svg)](https://codeofpaper.com/paper/2508.16672)

Discussion