Learning to Make Adherence-Aware Advice

Guanting Chen, Xiaocheng Li, Chunlin Sun, Hanzhao Wang
10/1/2023

No confident code implementation found for this paper.

Abstract

As artificial intelligence (AI) systems play an increasingly prominent role in human decision-making, challenges surface in the realm of human-AI interactions. One challenge arises from the suboptimal AI policies due to the inadequate consideration of humans disregarding AI recommendations, as well as the need for AI to provide advice selectively when it is most pertinent. This paper presents a sequential decision-making model that (i) takes into account the human's adherence level (the probability that the human follows/rejects machine advice) and (ii) incorporates a defer option so that the machine can temporarily refrain from making advice. We provide learning algorithms that learn the optimal advice policy and make advice only at critical time stamps. Compared to problem-agnostic reinforcement learning algorithms, our specialized learning algorithms not only enjoy better theoretical convergence properties but also show strong empirical performance.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. Any repos shown below are weak matches — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

A Q-learning Approach for Adherence-Aware Recommendations

87% match2023

Reinforcement Learning Interventions on Boundedly Rational Human Agents in Frictionful Tasks

83% match2024

Decision-aid or Controller? Steering Human Decision Makers with Algorithms

83% match2023

Designing Algorithmic Recommendations to Achieve Human-AI Complementarity

82% match2024

AI Recommendation Systems for Lane-Changing Using Adherence-Aware Reinforcement Learning

82% match2025

Opinion-Guided Reinforcement Learning

81% match2024

Cite this paper

@article{chen2023learning,
  title  = {Learning to Make Adherence-Aware Advice},
  author = {Guanting Chen and Xiaocheng Li and Chunlin Sun and Hanzhao Wang},
  year   = {2023},
  eprint = {2310.00817},
  archivePrefix = {arXiv},
  url    = {https://arxiv.org/pdf/2310.00817},
  journal = {ICLR 2023 2023}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2310.00817.svg)](https://codeofpaper.com/paper/2310.00817)

Discussion