AI Systems of Concern

Kayla Matteucci, Shahar Avin, Fazl Barez, Seán Ó hÉigeartaigh
10/9/2023
cs.AI

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

Concerns around future dangers from advanced AI often centre on systems hypothesised to have intrinsic characteristics such as agent-like behaviour, strategic awareness, and long-range planning. We label this cluster of characteristics as "Property X". Most present AI systems are low in "Property X"; however, in the absence of deliberate steering, current research directions may rapidly lead to the emergence of highly capable AI systems that are also high in "Property X". We argue that "Property X" characteristics are intrinsically dangerous, and when combined with greater capabilities will result in AI systems for which safety and control is difficult to guarantee. Drawing on several scholars' alternative frameworks for possible AI research trajectories, we argue that most of the proposed benefits of advanced AI can be obtained by systems designed to minimise this property. We then propose indicators and governance interventions to identify and limit the development of systems with risky "Property X" characteristics.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{matteucci2023systems,
  title  = {AI Systems of Concern},
  author = {Kayla Matteucci and Shahar Avin and Fazl Barez and Seán Ó hÉigeartaigh},
  year   = {2023},
  eprint = {2310.05876},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2310.05876v1}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2310.05876.svg)](https://codeofpaper.com/paper/2310.05876)

Discussion