Minion: A Technology Probe to Explore How Users Negotiate Harmful Value Conflicts with AI Companions

Xianzhe Fan, Qing Xiao, Xuhui Zhou, Yuran Su, Zhicong Lu +2 more
11/11/2024
cs.HCcs.AIcs.CL

No confident code implementation found for this paper.

Abstract

AI companions are designed to foster emotionally engaging interactions, yet users often encounter conflicts that feel frustrating or hurtful, such as discriminatory statements and controlling behavior. This paper examines how users negotiate such harmful conflicts with AI companions and what emotional and practical burdens are created when mitigation is pushed to user-side tools. We analyze 146 public posts describing harmful value conflicts interacting with AI companions. We then introduce Minion, a Chrome-based technology probe that offers candidate responses spanning persuasion, rational appeals, boundary setting, and appeals to platform rules. Findings from a one-week probe study with 22 experienced users show how participants combine strategies, how emotional attachment motivates repair, and where conflicts become non-negotiable due to companion personas or platform policies. We surface design tensions in supporting value negotiation, showing how companion design can make some conflicts impossible to repair in practice, and derive implications for AI companion and support-tool design that caution against offloading safety work onto users.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{fan2024minion,
  title  = {Minion: A Technology Probe to Explore How Users Negotiate Harmful Value Conflicts with AI Companions},
  author = {Xianzhe Fan and Qing Xiao and Xuhui Zhou and Yuran Su and Zhicong Lu and Maarten Sap and Hong Shen},
  year   = {2024},
  eprint = {2411.07042},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2411.07042v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2411.07042.svg)](https://codeofpaper.com/paper/2411.07042)

Discussion