An analytical model of active inference in the Iterated Prisoner's Dilemma

Daphne Demekas, Conor Heins, Brennan Klein
6/27/2023
physics.soc-phcs.MA

No confident code implementation found for this paper. 3 possible matches can be shown below.

Abstract

This paper addresses a mathematically tractable model of the Prisoner's Dilemma using the framework of active inference. In this work, we design pairs of Bayesian agents that are tracking the joint game state of their and their opponent's choices in an Iterated Prisoner's Dilemma game. The specification of the agents' belief architecture in the form of a partially-observed Markov decision process allows careful and rigourous investigation into the dynamics of two-player gameplay, including the derivation of optimal conditions for phase transitions that are required to achieve certain game-theoretic steady states. We show that the critical time points governing the phase transition are linearly related to each other as a function of learning rate and the reward function. We then investigate the patterns that emerge when varying the agents' learning rates, as well as the relationship between the stochastic and deterministic solutions to the two-agent system.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 3 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Cite this paper

@article{demekas2023analytical,
  title  = {An analytical model of active inference in the Iterated Prisoner's Dilemma},
  author = {Daphne Demekas and Conor Heins and Brennan Klein},
  year   = {2023},
  eprint = {2306.15494},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2306.15494v2}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2306.15494.svg)](https://codeofpaper.com/paper/2306.15494)

Discussion