Abstracting Imperfect Information Away from Two-Player Zero-Sum Games

Samuel Sokota, Ryan D'Orazio, Chun Kai Ling, David J. Wu, J. Zico Kolter +1 more
1/22/2023
cs.GTcs.AIcs.LG

No confident code implementation found for this paper. 4 possible matches can be shown below.

Abstract

In their seminal work, Nayyar et al. (2013) showed that imperfect information can be abstracted away from common-payoff games by having players publicly announce their policies as they play. This insight underpins sound solvers and decision-time planning algorithms for common-payoff games. Unfortunately, a naive application of the same insight to two-player zero-sum games fails because Nash equilibria of the game with public policy announcements may not correspond to Nash equilibria of the original game. As a consequence, existing sound decision-time planning algorithms require complicated additional mechanisms that have unappealing properties. The main contribution of this work is showing that certain regularized equilibria do not possess the aforementioned non-correspondence problem -- thus, computing them can be treated as perfect-information problems. Because these regularized equilibria can be made arbitrarily close to Nash equilibria, our result opens the door to a new perspective to solving two-player zero-sum games and yields a simplified framework for decision-time planning in two-player zero-sum games, void of the unappealing properties that plague existing decision-time planning approaches.

View on arXivView PDF

Code Implementations

No confident code match yet

We couldn't find an author-owned or strongly-evidenced community implementation for this paper. 4 weaker matches are hidden by default — verify before relying on them.

No code implementations found yet.

Know of an implementation? Let us know in the comments below!

Similar Papers

Cite this paper

@article{sokota2023abstracting,
  title  = {Abstracting Imperfect Information Away from Two-Player Zero-Sum Games},
  author = {Samuel Sokota and Ryan D'Orazio and Chun Kai Ling and David J. Wu and J. Zico Kolter and Noam Brown},
  year   = {2023},
  eprint = {2301.09159},
  archivePrefix = {arXiv},
  url    = {http://arxiv.org/abs/2301.09159v3},
  journal = {ICML 2023 2023}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/2301.09159.svg)](https://codeofpaper.com/paper/2301.09159)

Discussion