OpenSpiel: A Framework for Reinforcement Learning in Games

Marc Lanctot, Edward Lockhart, Jean-Baptiste Lespiau, Vinicius Zambaldi, Satyaki Upadhyay +22 more
8/26/2019
cs.LGcs.AIcs.GT

Official code: google-deepmind/open_spiel (5,548 stars, Apache-2.0, last commit 2026-04-26).

Abstract

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games. OpenSpiel supports n-player (single- and multi- agent) zero-sum, cooperative and general-sum, one-shot and sequential, strictly turn-taking and simultaneous-move, perfect and imperfect information games, as well as traditional multiagent environments such as (partially- and fully- observable) grid worlds and social dilemmas. OpenSpiel also includes tools to analyze learning dynamics and other common evaluation metrics. This document serves both as an overview of the code base and an introduction to the terminology, core concepts, and algorithms across the fields of reinforcement learning, computational game theory, and search.

View on arXivView PDF

Code Implementations(1)

Apache-2.0

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

5,5481,204C, GoJul 22, 20195 months agoApache-2.0
cppgamesmultiagentpythonreinforcement-learning

Similar Papers

Cite this paper

@article{lanctot2019openspiel,
  title  = {OpenSpiel: A Framework for Reinforcement Learning in Games},
  author = {Marc Lanctot and Edward Lockhart and Jean-Baptiste Lespiau and Vinicius Zambaldi and Satyaki Upadhyay and Julien Pérolat and Sriram Srinivasan and Finbarr Timbers and Karl Tuyls and Shayegan Omidshafiei and Daniel Hennes and Dustin Morrill and Paul Muller and Timo Ewalds and Ryan Faulkner and János Kramár and Bart De Vylder and Brennan Saeta and James Bradbury and David Ding and Sebastian Borgeaud and Matthew Lai and Julian Schrittwieser and Thomas Anthony and Edward Hughes and Ivo Danihelka and Jonah Ryan-Davis},
  year   = {2019},
  eprint = {1908.09453},
  archivePrefix = {arXiv},
  url    = {https://arxiv.org/abs/1908.09453}
}

Add a badge to your README

Shows whether official code is linked for this paper.

Code of Paper badge
[![Code of Paper](https://codeofpaper.com/badge/1908.09453.svg)](https://codeofpaper.com/paper/1908.09453)

Discussion